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MANAGEMENT OF AIR TRAFFIC CONTROLLER 
TRAINING CONTRACTS 


TUESDAY, JANUARY 14, 2014 

U.S. Senate, 

Subcommittee on Financial and Contracting Oversight 
OF THE Committee on Homeland Security 
AND Governmental Affairs, 

Washington, DC. 

The Subcommittee met, pursuant to notice, at 2:34 p.m., in room 
SD-342, Dirksen Senate Office Building, Hon. Claire McCaskill, 
Chairman of the Subcommittee, presiding. 

Present: Senators McCaskill and Johnson 

OPENING STATEMENT OF SENATOR MCCASKILL 

Senator McCaskill. Good afternoon. I apologize for being a few 
minutes late. We just finished our weekly caucus, and as usual, it 
was rainbows and unicorns. Just kidding. It was contentious and 
difficult today, so we went over a little bit. 

This hearing will now come to order. We are here today to review 
the Federal Aviation Administration’s (FAA) management of the 
Air Traffic Control Optimum Training Solution (ATCOTS). 

ATCOTS is an important contract because it supports the train- 
ing of this Nation’s air traffic controllers, who, in turn, manage the 
Nation’s air traffic, a critical service. In the next few years, we ex- 
pect to see more and more retirements from the generation of air 
traffic controllers that were hired after the 1981 strike. At the time 
this contract was awarded in 2008, the FAA had a goal to hire and 
train 17,000 controllers by 2015 in order to meet the expected de- 
mand. The FAA also wanted to improve training to meet the needs 
of the new NextGen air traffic control system. 

In order to achieve this goal, the FAA awarded a contract to 
Raytheon to provide training to facilities across the Unied States 
in 2008. In 2010, 2 years into the contract, the Department of 
Transportation Office of Inspector General (DOT OIG) audited this 
contract and found significant problems. The contract was premised 
on certain parameters, that there were going to be 4,000 recruits 
to train and 159 sites to support. But within just a few months, 
those numbers had increased dramatically, to 5,620 recruits at 195 
sites. The cost of the contract had skyrocketed, and FAA was in 
danger of running out of money under the contract. 

The Inspector General (IG) had several recommendations for the 
FAA. The most important one was that FAA needed to figure out 
what training it needed and how much it was going to cost. Unfor- 
tunately, FAA failed to take the IG’s recommendation to heart. In- 
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2 


stead, FAA let the contract continue unchanged, racking up at 
least $89 million in additional costs to the taxpayer. Finally, as 
warned by the Inspector General, FAA ran out of money a year 
early. 

Again, FAA had the opportunity to follow the IG’s common sense 
recommendation to figure out what training it needed. Instead, 
FAA decided the best course of action was to exercise the contract’s 
option period early. 

I wrote to the then-Acting Administrator Huerta in 2012, asking 
FAA to consider its plan carefully and to implement the Inspector 
General’s recommendations by updating cost estimates, defining 
training requirements, and developing performance measures for 
the contractor as opposed to the inappropriate notion that the con- 
tractor provided their own performance measures, all basic ele- 
ments of good contracting. But, FAA did not do this. 

In 2013, the Inspector General released a second report about 
the ATCOTS contract. The Inspector General found that while 
there has been some improvement, FAA still has not figured out 
its training needs. In addition, it appears that FAA has managed 
to bring the costs of the contract under control only by cutting the 
amount of training provided by the contractor and instead relying 
on Certified Professional Controllers to fill the gaps. FAA has been 
unable to tell the Inspector General or this Subcommittee how 
much using these highly paid government employees had added to 
the costs of training new air traffic controllers. 

In addition, more than 5 years and $512 million later, the FAA 
has not achieved any of the three critical goals of the original 
ATCOTS contract: Reduce training costs, reduce training times, 
and bringing training innovations. 

Today’s hearing is about learning from the past mistakes, fixing 
problems, and moving forward. I want to spend some time having 
a discussion with the Office of Inspector General, the FAA, and 
Raytheon in order to understand how these problems came about 
and why they have not been addressed earlier. I want to learn 
what both the FAA and Raytheon are doing right now to get this 
contract back on track and what is being done to try and achieve 
some of the initial goals of the contract. 

I also want to understand what the FAA is doing to better man- 
age and oversee its contracts. This is especially important because 
I understand that the FAA may start the acquisition process on a 
new training contract later this year. I want this Subcommittee to 
be satisfied that FAA has learned its lesson and will not make 
these mistakes again. I want to know that the FAA is taking con- 
crete steps to address deficiencies, is committing to making smart 
contracting decisions, and will ensure that its own acquisition poli- 
cies are actually followed. I do not want to be here in a year’s time 
having the exact same hearing again. 

Congress and the American public have entrusted the FAA with 
taxpayer dollars and trust them to maintain the safety of our air- 
space. Just this weekend in my State, a plane mistakenly landed 
on the wrong airport in Missouri, coming dangerously close to the 
end of a runway that was too short for the aircraft in question. 
While there is no evidence of a connection of what we are exploring 
here today and what happened in Missouri, it is hard to under- 
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stand how the air traffic controllers allowed a Southwest Airline — 
and we are not talking about a small general aviation aircraft, we 
are talking about a domestic carrier of American citizens — how 
they allowed them to land at the wrong airstrip, at the wrong air- 
port, on the wrong runway. 

It is a timely reminder of the need to ensure that the resources 
we spend on air traffic safety are spent effectively, and that if we 
do not have enough in the contract to adequately train our control- 
lers, that we confront that rather than continuing to renew con- 
tracts that have not been working or have not had the oversight 
that common sense dictates. 

I thank the witnesses for being here and I look forward to their 
testimony. 

Senator Johnson. 

OPENING STATEMENT OF SENATOR JOHNSON 

Senator Johnson. Thank you. Madam Chairman. You are cor- 
rect. This is a very timely hearing. I appreciate you calling it. 

I did read the Inspector General’s report. It raised probably more 
questions than it answered, so I will certainly second your opening 
comment in terms of all the questions that you would like to have 
answered during the hearing. 

One of the things I certainly did in reviewing this and getting 
ready for this hearing is just take a look at the reasonableness of 
the cost per training. Since 2009, the average cost — this is per the 
Raytheon contract — was about a little under $20,000 per air traffic 
control trainee. It rose to as high as $29,000, and in 2013 was 
about $26,000. That is relatively high training costs. You can com- 
pare that to college education. So, based on that information, I do 
not know if that is appropriate or inappropriate in terms of the 
total expense. I want to understand exactly how the training oc- 
curs, who is doing it, how much is done by the FAA, how much is 
done by Raytheon, what the breakdown is, how intensive this 
training is. So, I just really want to understand the complete train- 
ing process. 

I am certainly looking forward to the testimony. I am hoping that 
is the kind of information I certainly get out of this hearing. But, 
again, I certainly thank the witnesses for coming here and being 
willing to testify and look forward to your testimony. 

Thank you. Madam Chairman. 

Senator McCaskill. Let me introduce the witnesses today. 

First, we have Mary Kay Langan-Feirson, who is the Assistant 
Inspector General for Acquisition and Procurement Audits at the 
U.S. Department of Transportation, Office of Inspector General. In 
this capacity, she oversees audits relating to the Department of 
Transportation acquisition and procurements, including direct con- 
tracts and contracts awarded by grantees. Prior to joining the Of- 
fice of Inspector General, Ms. Langan-Feirson worked in the De- 
partment of Transportation’s Office of General Counsel for 30 
years. 

Patricia McNall is the Chief Acquisition Officer and Deputy As- 
sistant Administrator for Finance and Management at the Federal 
Aviation Administration, and I will say with a sense of a humor, 
obviously the person who got the short straw at the FAA. I will say 
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on the record, I am disappointed — not that I am not thrilled to 
have you, Ms. McNall, but I think the person who should be sitting 
there should be the person who has oversight of this program. They 
declined to attend this and sent you, and that — I will give you a 
chance to address that when you testify, but I do not think you are 
in a position to know as much about this as we need to know and 
it is disappointing, but I will tell you candidly in this particular 
area, I was not shocked when I heard that you were being sent in 
terms of getting the short straw. 

In your outstanding 30-year FAA Career, you have served in var- 
ious positions, including Acting Deputy Assistant Administrator for 
Policy, Planning, and International Aviation, and Deputy Assistant 
Chief Counsel for FAA’s Technical Center. Prior to assuming your 
current position, you were the FAA’s Assistant Chief Counsel for 
Acquisition and Commercial Law. 

Lynn Dugle is a Vice President at Raytheon Company, and Presi- 
dent of Raytheon Intelligence, Information, and Services, a position 
she has held since 2009. Before joining Raytheon in 2004, Ms. 
Dugle held officer-level positions with ADC Telecommunications 
and began her career at Texas Instruments. 

I thank all three of you for being here. It is the custom of this 
Subcommittee to swear in all witnesses that appear before us, so 
if you do not mind, I would ask you to stand and take the following 
oath. 

Do you swear that the testimony that you are about to give be- 
fore this Subcommittee will be the truth, the whole truth, and 
nothing but the truth, so help you, God? 

Ms. Langan-Feirson. I do. 

Ms. McNall. I do. 

Ms. Dugle. I do. 

Senator McCaskill. Thank you all very much. 

We will be using a timing system today. We are not sticklers 
about that, but we will ask you to try to keep your testimony to 
5 minutes. Obviously, you are welcome to supplant your oral testi- 
mony today with any other information you would like to have us 
put in the record concerning our hearing topic. 

And we will begin with you, Ms. Langan-Feirson. 

TESTIMONY OF MARY KAY LANGAN-FEIRSON, i ASSISTANT IN- 
SPECTOR GENERAL, ACQUISITION AND PROCUREMENT AU- 
DITS, OFFICE OF THE INSPECTOR GENERAL, U.S. DEPART- 
MENT OF TRANSPORTATION 

Ms. Langan-Feirson. Chairman McCaskill, Ranking Member 
Johnson, thank you for inviting me here today to testify on FAA’s 
Air Traffic Control Optimum Training Solution contract. The $859 
million contract was intended to provide up to 10 years of support 
to train approximately 17,000 air traffic controllers, most of whom 
FAA planned to hire over the next decade. 

In September 2010, we reported several contract weaknesses 
that challenged FAA’s efforts to effectively manage the ATCOTS 
program. FAA has made progress in addressing many of the weak- 
nesses we identified. However, more than 3 years after that report. 


^The prepared statement of Ms. Langan-Feirson appears in the Appendix on page 31. 
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FAA has yet to address our most important recommendation, 
which is to clearly define controller training requirements and de- 
termine whether they can be achieved within the existing cost 
baseline of $859 million. 

Specifically, we recommended that FAA update its training re- 
quirements and develop criteria for determining whether the agen- 
cy should exercise contract options beyond the 5-year base contract. 
Despite our recommendation, the ATCOTS program experienced 
four consecutive years of cost overruns, totaling about $89 million, 
due largely to FAA’s lack of clearly defined requirements. In the 
first 2 years alone, contract costs exceeded negotiated values by 
$46 million, and the contractor was required to provide far more 
training than FAA originally estimated. 

As a result, FAA ran out of money in the fourth year of the base 
contract and was not prepared to make an informed decision on 
how to best meet its controller training program needs. Ultimately, 
FAA chose to exercise the contract’s first option period a year ear- 
lier than planned without first clearly defining its training require- 
ments or determining whether to exercise the option or take a dif- 
ferent acquisition approach. 

In our most recent report, released last month, we know that 
FAA has taken some steps to better assess its training needs. For 
example, FAA reestablished its use of an annual workplan to better 
identify training requirements. However, the plan still does not 
capture all of FAA’s training needs, including training on new air 
traffic controller systems, such as the En Route Automation Mod- 
ernization (ERAM). If FAA does not clarify and update its training 
requirements, the ATCOTS program remains at risk of cost over- 
runs in the future. 

During our recent audit of ATCOTS, we also identified contract 
management weaknesses that undermine FAA’s ability to achieve 
its training goals. For example, FAA has not used its award fees 
or incentive fees to manage the contract effectively. One of the 
FAA’s key training goals is to reduce training times, but the award 
fee performance measures have not been adequately linked to this 
goal, an issue we first reported in 2010. Between fiscal years 2009 
and 2012, controller training times actually increased by an aver- 
age of 41 percent, taking 9 months longer, on average, to certify 
each controller. Over the life of the contract, FAA paid the con- 
tractor over $17 million in award fees for performance measures 
that did not effectively motivate the contractor. FAA also paid $14 
million in incentive fees despite 4 years of cost overruns. This is 
counterintuitive to the concept in use of award fees. 

In its response to our 2013 report, FAA announced that its goal 
is to award a new contract to replace ATCOTS as early as fall of 
2014. To avoid repeating the problems with ATCOTS, it is crucial 
that FAA address our recommendation to clearly define its training 
requirements and decide whether it needs to rebaseline before 
awarding a new contract. We will continue to monitor FAA’s 
progress in implementing our recommendations and provide this 
Committee, the Secretary, and FAA with future updates on the 
program. 

This concludes my prepared remarks. I would be happy to an- 
swer any questions you may have. 
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Senator McCaskill. Thank you very much. 

Ms. McNall. 

TESTIMONY OF PATRICIA MCNALL, i DEPUTY ASSISTANT AD- 
MINISTRATOR, ACQUISITIONS AND BUSINESS SERVICES, 

FEDERAL AVIATION ADMINISTRATION, U.S. DEPARTMENT 

OF TRANSPORTATION 

Ms. McNall. Good afternoon, Chairman McCaskill and Ranking 
Member Johnson. I am Pat McNall, the FAA’s Acquisition Execu- 
tive, and I am responsible for the agency’s acquisitions. I appre- 
ciate this opportunity to speak with you today about the FAA’s Air 
Traffic Controller Training Contract. 

The FAA’s mission is to ensure the safest, most efficient airspace 
system in the world, but we are also committed to cost effective- 
ness. The taxpayer expects and deserves nothing less. 

In 2005, the FAA projected the need to hire 17,000 controllers by 
2015. This unprecedented level of hiring and training was nec- 
essary to replace the large number of expected retiring controllers 
and meet projected increases in air travel demand. To manage this 
large training effort, the FAA proposed replacing two existing level 
of effort contracts with a single centrally managed performance- 
based contract. Simply put, this means we were removing and 
transitioning from existing contracts where we specified the num- 
ber of instructors and the method of providing the training to a 
new contract that would specify the number controllers to be 
trained, plus or minus 10 percent, allow the contractor to deter- 
mine the best means of training these controllers, while we meas- 
ure its effectiveness and ability to do so according to pre-set 
metrics. 

In September 2008, after running a full and open competition, 
the FAA awarded the contracted titled the Air Traffic Control Opti- 
mum Training Solution contract, to Raytheon Technical Services 
Corporation with a ceiling value of $859 million. In the early years 
of the contract, however, we encountered significant challenges and 
costs. We underestimated the difficulty in transitioning from level 
of effort contracts in place for over 20 years to the new perform- 
ance-based ATCOTS contract. We reverted to the methods we knew 
had been working in the past. Our training needs, both in the num- 
ber of students and the technology for which we needed to provide 
the training, accelerated faster than we anticipated. We incurred a 
substantial cost, accordingly. 

We have taken significant steps to improve our management of 
the ATCOTS contract. I would like to highlight a few of these 
steps. The FAA provided increased management attention and re- 
quirements control by consolidating all training under the FAA’s 
Air Traffic Organization Vice President for Safety and Technical 
Training. Additionally, we imposed an award fee structure that mo- 
tivates the contractor to control costs. We implemented a new 
training planning tool to better define and control our dynamic 
training needs. We developed guidelines to monitor required per- 
formance standards and expected outcomes for the contractor, and 
we hold our oversight staff accountable for overseeing these stand- 


^The prepared statement of Ms. McNall appears in the Appendix on page 41. 
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ards. These changes are improving our oversight, management, 
and administration of the ATCOTS contract. 

We appreciate the Office of Inspector General’s audit of the con- 
tract. We are confident that the measures we have taken, which 
fall in line with their recommendations, will allow us to stay on 
track for the remainder of this contract. 

The FAA recently issued a market survey and request for infor- 
mation as the first step to a possible replacement of the ATCOTS 
contract. If we proceed with this procurement, we will replace the 
contract before the end of this calendar year. Whether we replace 
it or not, I am confident that we will continue to provide quality 
air traffic control training. 

The training of air traffic controllers will continue to be a critical 
need for the agency. We estimate that we will need to hire 11,700 
controllers by the year 2022. In order to maintain safety and han- 
dle the high volume of air traffic, we need to maintain a steady hir- 
ing and training rate through this time. Our ability to do that, 
however, has been challenged by decreased funding, including the 
sequestration. All training courses at the FAA Academy were can- 
celed since sequestration was implemented and have only resumed 
this month. 

The FAA was also unable to hire any new air traffic controllers 
and will have to now accelerate hiring, budget permitting, to en- 
sure that we have a sufficient number of controllers. This increased 
rate of hiring will bring with it increased training requirements be- 
yond what we predicted for this coming year. 

Whenever we face uncertainty about hiring and funding, we face 
uncertainty about our training requirements. This makes it very 
difficult to predict, cost, and plan for the best and most effective 
cost effective contract we can have, but we remain committed to en- 
suring the safety of the National Airspace System and will not ever 
compromise safety, even in these uncertain times. 

Ms. Chairman, this concludes my statement and I would be 
happy to take questions at this time. 

Senator McCaskill. Thank you very much. 

Ms. Dugle. 

TESTIMONY OF LYNN DUGLE, i PRESIDENT, INTELLIGENCE, 
INFORMATION, AND SERVICES, RAYT H EON COMPANY 

Ms. Dugle. Good afternoon. Chairman McCaskill and Ranking 
Member Johnson. I am Lynn Dugle, President of the Intelligence, 
Information and Services business of the Raytheon Company, the 
business which is the prime contractor for the ATCOTS program. 
Thank you for the opportunity to address the Subcommittee on 
Raytheon’s management of the program, our ongoing efforts to re- 
duce cost, and the new training innovations we can bring to the 
program. 

Before I do so, let me provide some relevant context on Raytheon 
and our training. We are one of the world’s leading providers of 
mission critical training solutions. We train more than two million 
people a year whose missions include national defense, U.S. intel- 
ligence operations, cybersecurity, and, of course, national airspace 


^The prepared statement of Ms. Dugle appears in the Appendix on page 49. 
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management. In addition, our training solutions extend to critical 
needs in the commercial sector. 

Raytheon is also one of the world’s largest providers of air traffic 
management systems. Our systems control more than two-thirds of 
the world’s airspace and our company is an active participant in 
the FAA’s Next Generation program. 

By way of starting, let me say that Raytheon agrees with the 
general conclusion of the IG report that progress has been made, 
yet much more work remains. Raytheon and the FAA have built a 
partnership that has addressed the agency’s very dynamic training 
needs for more than 5 years. During the last year, we have acceler- 
ated those improvements, and now, we have a solid foundation to 
get future gains. 

Let me now share my thoughts on the three topics that the Com- 
mittee requested Raytheon to cover, management of the contract, 
cost reductions, and new training innovations or transformation. 

The management of this contract was challenged from the start 
by those unexpected increases in cost and scope that were identi- 
fied after the contract began. This included a hiring surge that re- 
sulted in a 40 percent increase in year one. There were also new 
training requirements for 700 of these new trainees. There were 
new air traffic control system modernization requirements, the 
ERAM that you mentioned, and new tower simulation needs. 

Nevertheless, Raytheon responded to those challenges by train- 
ing 20 percent more individuals over the 4-year period. We lowered 
the cost per student on Raytheon-delivered training by 6 percent, 
lowered the cost — decreased the controller failure rate by 12 per- 
cent. We shortened class durations at the Academy by 10 percent. 
And we achieved a 23 percent increase in the utilization of the 
complex and expensive tower simulators. 

On the topic of cost reduction, Raytheon and the FAA are work- 
ing together to maximize the training that can be delivered, can be 
accomplished, within the budget given. Let me cover some of the 
changes we have already made. 

For the first time, FAA’s field managers, onsite managers, are in- 
volved in deciding local training priorities, which will lead to more 
effective and more efficient training across the system. Their in- 
volvement was enabled by a new planning and execution tool devel- 
oped by Raytheon at our own expense to assist with that planning. 
In partnership with the FAA, we have also implemented new work- 
force practices and scheduling efficiencies at the Academy that will 
reduce the fiscal year (FY) 2014 costs by an additional 5 percent. 
We have also reduced our Program Management Office by 20 per- 
cent, after working with the FAA to streamline contractual report- 
ing requirements. This reduction will result in $2 million of annual 
savings. 

Let us shift to the topic of new training innovations. I, again, 
agree with the IG report that significant opportunities exist to fur- 
ther modernize training and reduce our cost. With support and ap- 
proval from the FAA, we can implement innovations that will allow 
us to deliver high-quality training at a much lower cost. 

Raytheon has provided numerous proposals and white papers 
outlining potential areas for important innovations. The biggest op- 
portunity now before us is the implementation of the ATCOTS Cur- 
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riculum Architecture Project. This project created a blueprint for 
the systematic modernization and transformation of air traffic con- 
troller training by identifying the best training mechanisms, meth- 
odologies, and then how to best sequence the training to avoid any 
duplication. We have also presented and shared other opportunities 
with the FAA, such as Virtual Classroom Training and the imple- 
mentation of remote training for the Air Traffic Basics Course, both 
of which I discussed in more detail in my written testimony. 

I would like to conclude by emphasizing that significant progress 
has been made over the past year in a very complex, challenging, 
and critically important program. Raytheon and the FAA have es- 
tablished a solid foundation for future performance gains and fu- 
ture cost reductions. I believe Raytheon has the program knowl- 
edge, the transformational training capabilities, and the larger air 
traffic management domain experience to continue to collectively 
support the FAA and meet the training needs of our air traffic con- 
trol professionals. 

Thank you very much for the opportunity. I look forward to an- 
swering any questions you may have. 

Senator McCaskill. Thank you, and once again, I appreciate all 
of you being here. 

I would ask each of you before we begin questioning, if you 
would, to try to assign a grade to the management and oversight 
of the ATCOTS contract. Ms. Langan-Feirson, what grade would 
you give it? 

Ms. Langan-Feirson. An incomplete. 

Senator McCaskill. Ms. McNall. That was kind. Ms. McNall. 

Ms. McNall. I am inclined to agree. Actually, I would also point 
out, I think the grade has changed over time, all right, so I would 
say we started off with a C, at best, and then it progressed to a 
B. 

Senator McCaskill. OK. And Ms. Dugle. 

Ms. Dugle. I think on the management of the program and 
meeting our budget constraints, none of us would be pleased with 
our grade. I think on the quality of the training delivered, I would 
give us a much higher grade. I also would warmly embrace the 
idea that we have improved through time, improving more and 
more as each year has progressed. 

Senator McCaskill. I know that the FAA has implemented some 
of the recommendations from the initial audit, though. I think the 
thing that is hardest for me is, as was mentioned in Ms. Langan- 
Feirson’s testimony, it did not implement the most critical rec- 
ommendation, which is to assess your training needs and figure out 
what you want. That is the most important thing in contracting in 
government, is to know what you want. You cannot get a bargain 
if you do not know what you want. You cannot, frankly, adequately 
oversee a contract unless you know what it is you are actually ac- 
quiring, what you want, and how much it is going to cost. And it 
is still unresolved. Can you address that, Ms. McNall? Why is this 
so hard to figure out what you want and what it is going to cost? 

Ms. McNall. Yes, ma’am. Actually, let me explain a little bit 
about the training process. It is a very dynamic situation. The piece 
that is actually in many ways the easiest, and if I do a new con- 
tract it is easy enough that I am even thinking maybe we can fix 
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price to work, is when we hire controllers, we bring them to the 
Academy and they provide a very basic FAA air traffic controller 
training, all right. That is the first step of the training process. 
That, at least I know I am hiring X-number of people. They are 
going to come into a class and the class is going to be conducted 
roughly like this, absent any training innovations. 

From there, they go to an air traffic control facility, all right, and 
they are going to get some additional training at that facility. This 
is where it becomes a very dynamic situation. Although we know 
we have a bow wave of retirements coming, because we have a 
mandatory age cap by which controllers must retire, and as you 
know, we had to hire a great number of controllers all at one par- 
ticular point in time, which means they are more or less going to 
be retiring at the same time — because of that, we know we need 
to hire a lot. We know we have to train a lot. 

But I do not know ahead of time which specific controller is going 
to retire at which specific facility and what position that controller 
is on. For the FAA air traffic controller training, it has to be, when 
you get to the facility level, unique not only to that facility, but 
unique to that particular position that the controller is on. We pre- 
dict as best we can, and we have developed a training tool with 
Raytheon that we have implemented with our field that now in- 
volves a rolling process that we know with a fairly good place, at 
least 30 days ahead, 60 days ahead, and 90 days ahead, what we 
think that training will be that we can then pinpoint and identify. 

Once the controller candidate, so to speak, graduates and 
changes that applies not only to new trainees, that applies to exist- 
ing controllers who may need to be trained. If they are going to 
change positions, they need to be trained for the new position to 
which they are going to move. If they are going to change facilities, 
they need training for that new facility as well as the new position 
on which they are going to be. 

At that point, the FAA takes over the training and we use our 
professional air traffic controllers to provide on-the-job training. 
On-the-job training accounts for about 75 percent of the total 
amount of training that our controllers go through. In fact, that is 
the majority of the cost of our training program. 

Senator McCaskill. And how much is that training costing you? 

Ms. McNall. We provided some figures for the Committee and 
I can look it up again, but total cost is around $250,000 per con- 
troller, approximately. That is total cost of both our contractor 
training and our own employee training. 

Senator McCaskill. So, 75 percent of that is your employees? 

Ms. McNall. Or more, yes. 

Senator McCaskill. OK. So, you are saying that 75 percent of 
$250,000 is being done by your folks. 

Ms. McNall. In fact, I can provide that for the record, if you 
like. I do have some figures with me I can go through with you, 
if you like, on what our labor costs are for our employees to train 
you. 

Senator McCaskill. OK. I will come back to this on the second 
round because I need to talk to my staff, because we discussed this 
and this is the first I have heard this number and I want to go 
through it with them while Mr. Johnson is questioning you. 
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Ms. McNall. Mm-hmm. 

Senator McCaskill. Why in the world would you go from 4,000 
to 5,620 in the first year? How could the contract he that far off 
that soon, that close to the beginning of the contract? 

Ms. McNall. Yes, ma’am. Actually, we do not agree with that 
5,600 number. I understand exactly where the number came from, 
or at least we think we do, but we cannot match it with our own 
records. The contract provided that the controller would, for each 
year, need to train about 4,000 controllers, and it said, plus or 
minus 10 percent. 

Senator McCaskill. Right. 

Ms. McNall. We do agree the number was higher, and by our 
calculations was around 4,500 to 4,600. I think, and doing it wrong. 
It is different data systems that collect the data that I think is 
helping lead to why there is a bit of a difference 

Senator McCaskill. OK. Wait. Let us back up here. 

Ms. McNall. Mm-hmm. 

Senator McCaskill. So, you are telling me that you are paying 
for training for these people and you are not even sure and cannot 
articulate why the IG would say there was 5,620 and you are say- 
ing there was 4,500? 

Ms. McNall. No, I can definitely articulate that. The 5,600 was 
Raytheon’s number, which we believe includes all people initially 
put into the class, whether or not they graduated from the class or 
washed out. It includes training that we would otherwise not nec- 
essarily have counted, all right. So 

Senator McCaskill. Well, why did you pay them for it, then? 

Ms. McNall. Oh, one thing, it is a cost reimbursement contract 
and we treated it like a level of effort contract, and the way we 
should have is basically a performance-based contract. But they 
were successful in training this number of personnel, and we do 
agree — they did put in a request for equitable adjustment and at 
the end, we agreed they did train more than we expected. So, if you 
take the plus 10 or minus 10 percent, that makes 4,400 at the op 
side. We do agree they trained at least 4,500 to 4,600. 

In addition, they had to do different kinds of training. There is 
a separate requirement which says that we can only vary by 3 per- 
cent the different categories of training and we varied more than 
that. So, some of the technology training was increased. Some of 
the training for controllers that are already trained but now need 
to be trained for new positions, that was higher than we antici- 
pated, as well. 

Senator McCaskill. OK. So, you thought the most you were 
going to pay for was 4,500. You paid for 5,600, correct? 

Ms. McNall. I would 

Senator McCaskill. Is that correct, Ms. Langan-Feirson, that 
they paid for 5,600 the first year? 

Ms. Langan-Feirson. The numbers that we have are that FAA 
underestimated the number of controllers by 41 percent. There 
were 5,620 developmentals rather than 4,000 that was in the solici- 
tation. 

Senator McCaskill. OK. So, here is the problem. You are paying 
a thousand over. Forty percent is the figure that they are using. 

Ms. McNall. Right. 
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Senator McCaskill. And what happened when that occurred? 
Were there alarm hells that rang? Did everybody get together and 
say, we have to look at this contract, we have to change some 
things and we have to figure out what our number is for next year, 
and so the next year, it got better? 

Ms. McNall. Yes, ma’am, we did 

Senator McCaskill. No, it did not. You still had major cost over- 
runs the next year. 

Ms. McNall. Yes, we did, but the cost runs were less, not near- 
ly — do not get me wrong, the cost overruns were still present and 
they were present for the third year, as well, and I am horrified 
by that, as well, all right. But, we started a positive trend, all 
right. We got our controls. I will tell you, honestly, the first 3 years 
of the contract, management in particular were very troubling. The 
fourth year, we got better. That is why I am saying we succeeded 
in our most important goal, which is getting air traffic controllers 
trained as needed and providing the quality of training that was 
needed. The problem was the cost control 

Senator McCaskill. Well, I think, there, the issue is that — even 
in this testimony today, there does not seem to be a clear expla- 
nation that can be articulated between the difference in what you 
contracted for and what you paid for, and it does not even appear 
that you agree that they were training — that they should have 
been training all the people they were training, based on the testi- 
mony you have just given, that they were doing training you did 
not even anticipate them doing. 

And so you say it was a lot different in the second year, but my 
recollection is the first year, it was $40 million over — or $20 million 
over? 

Ms. McNall. No, 20 over. 

Senator McCaskill. The first year 20 over, and then the second 
year, was it not 20 over again? 

Ms. McNall. Not quite. 

Senator McCaskill. It was $29 million the first year and $31 
million the second year. 

Ms. McNall. I will be happy to double-check those numbers for 
you, with you and confirm back. The issue we had that was — keep 
in mind, the difference between a level of effort contract or our con- 
tract where I am paying per controller, which was an idea we origi- 
nally contemplated, but the IG appropriately pointed out to us 
would not be appropriate, it is a performance-based contract. So, 
we are not training per controller. We are training the volume of 
controls, whatever that amount might be, so long as it is within 10 
percent of 4,000, right. Above that, we recognize, yes, where the 
contract is entitled to an equitable adjustment, as well as if the 
mix changes of controllers beyond what we anticipated, and we 
agreed, that mix also did change. It did entitle the contractor to an 
equitable adjustment. 

One of the things we did that first year, for example, on the in- 
centive fee, they only got their minimum fee. They got nothing 
more than that. 

Senator McCaskill. OK. All right. Let me let Senator Johnson 
ask, and then I will come back and followup. 

Ms. McNall. Mm-hmm. 
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Senator Johnson. Let me use a little accounting lingo here. You 
have a price variance and you have a 

Ms. McNall. Yes. 

Senator Johnson [continuing]. A volume variance. It sounds to 
me like the problem with the contract was a volume variance. You 
had to train more air traffic controllers, is that accurate? 

Ms. McNall. That is largely accurate, and the only reason why 
I am hesitating at all is one of the things the FAA did was require 
this contractor to mirror the level of services being provided by the 
prior contractor without first evaluating, were all of those services 
the prior contractor had providing needed. We just told the con- 
tractor, go out, every facility at which our prior contractor was at, 
provide at least that amount of staffing. While we were running 
the procurement, which in this case was a little bit longer process 
than normal, that prior contractor was continuing to expand the 
sites at which they were present and providing training. In fact, 
that grew, although it was known within the agency 

Senator Johnson. So, you had training overlap between two con- 
tractors, which 

Ms. McNall. Yes. 

Senator Johnson. OK. 

Ms. McNall. Three contractors, in fact, since we were replac- 
ing — 

Senator Johnson. Let us just back up 

Ms. McNall. Right. 

Senator Johnson [continuing]. Because, I mean, I am new to 
this whole issue. Can you give me a little bit of history of training 
in the air traffic control system? For example, after the professional 
air traffic controllers organization (PATCO) strike, we had to hire 
a lot of people. We had to train a lot of people. 

Ms. McNall. That, we did. 

Senator Johnson. Was that done internally, on-the-job training? 
Was that done with an outside contractor? 

Ms. McNall. It was done with the help of an outside contractor, 
just as it is today. For approximately 20 years before this contract, 
all right, we started off with training at our Academy in Oklahoma 
City. The Academy in Oklahoma City contracts, and at that point, 
they were contracting with Oklahoma University to provide train- 
ing at the Academy. So, that was the starting point. That was the 
same up until we competed and Raytheon won the contract. 

Senator Johnson. So, prior to that, you were actually contracting 
with a university to do the training? 

Ms. McNall. Yes, at FAA’s facilities. So, it is not like we were 
sending them to college or university. 

Senator Johnson. Who would be the other potential competitors 
for this contract, other universities? Other private sector busi- 
nesses? 

Ms. McNall. Yes to both, because Oklahoma University was 
only providing Academy training, which was sort of the initial ba- 
sics course at this one facility. We hired potential air traffic con- 
trollers. They take a test so we can determine, are they likely to 
be good air traffic controller candidates. If they pass that test, we 
hire them. We send them to the Academy to begin their training. 
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From there, we send them to the facilities where we think we are 
going to need the personnel, all right. Again, that is an estimate, 
because we do not know exactly who is going to retire when. But, 
based on statistics and historical patterns 

Senator Johnson. OK. 

Ms. McNall [continuing]. We do our best guess. At the field, a 
private sector contractor takes over, historically, a separate con- 
tractor. It was a small business company, Washington Consulting 
Group, held that contract for many years. 

Senator Johnson. How many different air traffic control posi- 
tions are there? I mean, how many different classifications of air 
traffic controllers are you training for, approximately? 

Ms. McNall. I 

Senator Johnson. I mean, is there just one kind of air traffic 
controller, or 

Ms. McNall. No. 

Senator Johnson [continuing]. Are there 10? Are there 30? 

Ms. McNall. No. The reason I am hesitating — I will promise I 
will get back to you for the record with a better answer. I can tell 
you that we have over 15 levels of facilities, so that is 

Senator Johnson. That was my next question. 

Ms. McNall. OK. 

Senator Johnson. OK. So you have 15 different types of facili- 
ties. 

Ms. McNall. No, 15 levels. OK. I will back up a little bit further. 

Senator Johnson. Because, then I was going to say, different 
types of equipment configurations. I am trying to get 

Ms. McNall. Right. 

Senator Johnson [continuing]. My arms around the complexity 
of the training situation. 

Ms. McNall. Yes. Absolutely. 

Senator Johnson. You have different sized airports 

Ms. McNall. Different sizes of facility. 

Senator Johnson [continuing]. Different sized towers, different 
equipment configuration, you have different 

Ms. McNall. And not just towers, sir, if I may, respectfully. 

Senator Johnson. OK. 

Ms. McNall. Right. We have towers. Then we have what are 
called Terminal Radar Control Facilities. They may or may not be 
located where the tower is. And then we have 22 route facilities 
across the country that handle air traffic. They basically handle 
different volumes of air traffic. 

So, not only do we have the difference in facility size and the dif- 
ference in equipment, the layout, et cetera, we also have different 
positions in that facility. So, one controller, for example, will only 
handle arriving air traffic. Another controller will handle only de- 
parting air traffic. Another controller will be watching, generally, 
out for field 

Senator Johnson. OK. So, let us go back. A number of different 
types of towers. 

Ms. McNall. Yes. 

Senator Johnson. Are they all the same, or are there different 
configurations of that? 

Ms. McNall. They are all 
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Senator Johnson. Pardon? 

Ms. McNall. They have very different configurations. 

Senator Johnson. So, how many different configurations, ap- 
proximately? I mean, are you talking about 100 different configura- 
tions? I mean, is each one 

Ms. McNall. Each 

Senator Johnson [continuing]. Totally separate, totally unique? 

Ms. McNall. We have tried to standard the physical layout of 
the towers, but the physical layout of each airport tends to be a lit- 
tle bit different, which means there are changes for each airport, 
accordingly, right. If there is a mountain here, if there is a cliff 
there, right, that is going to alter the procedure. The air routes 
that the controllers have to guide the pilots along, those vary, as 
well. 

Senator Johnson. OK. 

Ms. McNall. And, in fact, we have a variety of different air 
routes that go into any one facility. In fact, and then what air route 
can be used depends on the equipage of the aircraft, and the con- 
troller has to know and visualize within their mind not only where 
is that aircraft, but which route can I give this aircraft based on 
the training of the pilot from that aircraft as well as the equipage 
onboard the aircraft. 

Senator Johnson. OK. So, the bottom line here, without get- 
ting — 

Ms. McNall. Mm-hmm. 

Senator Johnson [continuing]. Spend a lot of time on the detail, 
which I 

Ms. McNall. Sorry. 

Senator Johnson [continuing]. Would be glad to get into at some 
point in time, but the bottom line is there is a great deal of com- 
plexity — 

Ms. McNall. Yes. 

Senator Johnson [continuing]. In trying to anticipate over a 10- 
year contract what those training requirements are going to be. 

Ms. McNall. Exactly. 

Senator Johnson. Is that at the core? And I will ask all three 
of you to comment, because, to me, just writing down, well, you 
have to define the training requirements, well, yes, of course. 

Ms. McNall. Right. 

Senator Johnson. But then, all of a sudden, you realize, defining 
the training requirements is unbelievably complex and it is very 
hard to anticipate. I mean, is that 

Ms. McNall. You are absolutely right. Senator. 

Senator Johnson. Does anybody want to disagree with that? 

Ms. Langan-Feirson. I would say 

Senator Johnson. Or chime in? 

Ms. Langan-Feirson. I would agree. It is a very complex task. 
I would also say that the FAA has been training controllers for a 
very long time and it is a very important task. 

Senator Johnson. Ms. Dugle. 

Ms. Dugle. And all I would answer is that one of the steps that 
we have taken is to actually create a very simple tool, but a veiy 
powerful tool, that takes that complexity, decomposes it, puts it 
into an automated spreadsheet where all of our then-onsite train- 
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ers — we talked about coming from headquarters predicting and 
scheduling training out onto the site. We then take that each 
month, analyze 30 days of history, we look at our current 30 days, 
and then we do the forward planning that 

Senator Johnson. So, Raytheon does its 10 to 25 percent — I am 
looking at 25,000 versus 250 and I am saying that is 10 

Ms. Dugle. Yes 

Senator Johnson [continuing]. But somewhere in that 10 to 25 
percent of the training, you do that on the very front end and 
then 

Ms. Dugle. We do that now on a continuous basis. 

Senator Johnson. But, I mean, in terms of the cycle of an air 
traffic controller. I mean, are you primarily handling the first year 
of training of an individual, and then it gets turned over to on-the- 
job training with FAA personnel? 

Ms. Dugle. It would be approximately a year. So, we do the 
Academy training. We then do the onsite training and then we 
transition to the FAA for the actual on-the-job training. So, we 
handle two of the three components. 

Senator Johnson. So, we can criticize the FAA for not having de- 
fined this training requirement. How critical are you of that? I 
mean, are you actually pretty sympathetic with the complexity of 
it, or do you think there could be just a far better job, even within 
the complexity, that we can always do a better job, but 

Ms. Dugle. I think we can always do a better job. What I will 
say, this program came under my responsibility in April and I be- 
came a student of air traffic control training. I never had any ap- 
preciation for the level of complexity. So, you have the individual 
component 

Senator Johnson. Are you asking for reassignment yet, or 

Ms. Dugle. Yes, that is right. [Laughter.] 

Ms. Dugle. I do not think I could pass the training, quite frank- 
ly. But when you put the variables — and I am from an engineering 
background, right, so to get a consistent answer, I have to have so 
many known variables in an equation. When I put in the personal 
talents, we screen candidates coming in, but this is a very com- 
plicated job. Not everyone can do it. Then we have all the factors 
that Pat talked about. So, I am 

Senator Johnson. Let me go over time just a little bit, just be- 
cause this ties in. How much remedial training are you on the front 
end having to do just because the applicants coming in, yes, they 
have a degree, but there are just deficiencies and you have to bring 
people up to speed in terms of whatever our education system 
should have done? 

Ms. Dugle. So, probably the best factual indicator of that is our 
fallout rate. When we assumed responsibility for training, that fail- 
ure rate was 29.5. Over the time period, we have reduced that to 
17 percent. I think in this kind of training, you would always run 
in some level of double-digits because you just absolutely cannot 
screen all the temporal and visual talent. 

Senator Johnson. So, the reduction really is better screening, 
better application process, better hiring procedures, and that would 
be 


Ms. Dugle. Well, and- 
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Senator Johnson [continuing]. On your part or on FAA’s part? 

Ms. Dugle. And on our ownership, constantly improving that 
training, right, modernizing the techniques so that people are bet- 
ter able to digest and retain knowledge. 

Senator Johnson. OK. Thank you. Sorry for going over. 

Senator McCaskill. No, it is no problem. 

Ms. McNall, the $250,000 figure that you cited in your testimony 
a few minutes ago, that is the first we have ever heard that num- 
ber. 

Ms. McNall. I apologize. 

Senator McCaskill. Well, you know, we have been at this since 

2010. 

Ms. McNall. Yes. 

Senator McCaskill. I have been writing letters. We have been 
trying to communicate with you and your agency. Now, we got 
some spreadsheets, finally, on Friday 

Ms. McNall. Yes. 

Senator McCaskill. and Ms. Langan-Feirson, I am not even 
sure if you have seen these, but we have on Friday, you finally 
gave us some information that says your Air Traffic Training De- 
tail for fiscal year 2012 is $359 million, is that correct? 

Ms. McNall. I believe that would be for the — if that is the sheet 
that shows the cost of FAA providing the training, I do not believe 
that sheet necessarily includes the contractor training. 

Senator McCaskill. You do not know whether it does or does 
not? 

Ms. McNall. I hate to put it this way. I am trying to — from that 
sheet, that would be FAA cost only. 

Senator McCaskill. This is FAA costs only? 

Ms. McNall. Yes. 

Senator McCaskill. OK. And is there a reason why this was un- 
available to us for years and we got it the Friday before the hear- 
ing? Would you not have this available? 

Ms. McNall. We do have that available. We have had that infor- 
mation available. I am sorry I did not know, at least personally. 
I, too, only joined this job fairly — well, 2011. Anyway, I did not 
know that you wanted that data, but, of course, we will be happy 
to provide that data 

Senator McCaskill. Well, let me just explain what we are trying 
to do here. 

Ms. McNall. Yes. 

Senator McCaskill. We are trying to figure out if you know 
what this costs. 

Ms. McNall. Yes, ma’am. 

Senator McCaskill. And we are trying to figure out if you know 
what it is you are buying. 

Ms. McNall. Yes. 

Senator McCaskill. I get that what you are doing is com- 
plicated. 

Ms. McNall. Yes. 

Senator McCaskill. But, at the end of the day, acquisition is 
about the people who know what they need buying it and having 
some idea what it costs. 

Ms. McNall. Absolutely. 
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Senator McCaskill. So, you understand my concern that we 
would have two IG reports and we would have a lot of criticism 
about cost overruns, and for the first time at this hearing, we fi- 
nally hear a figure about what you think it costs to train someone 
to be a functioning, well-informed, well-trained air controller, and 
the Friday before the hearing, we finally get numbers — do you have 
these numbers, Ms. Langan-Feirson? 

Ms. Langan-Feirson. No, I do not. 

Senator McCaskill. Have you tried to get these numbers? 

Ms. Langan-Feirson. In our report, we have — those — I do not 
know what those numbers are, but in our report, basically, one of 
the findings that we have is that the FAA is responsible for the on- 
the-job training. Raytheon is responsible for the Academy training 
and the developmental training, and then they get handed off for 
on-the-job. 

Senator McCaskill. Right. 

Ms. Langan-Feirson. The point is that the contract costs are 
under the contract and there are other costs that the FAA incurs 
to train an air traffic controller. You need to put those two together 
to get the total cost. 

Senator McCaskill. Absolutely. 

Ms. Langan-Feirson. And when we went into the field and we 
interviewed people in the field, we asked them whether they were 
capturing the costs for kind of the off-loading of the courses that 
Raytheon could not train because they ran up against the cost ceil- 
ings, were those being captured, those costs that the controllers 
were basically 

Senator McCaskill. Absorbing. 

Ms. Langan-Feirson. They were self-performing and absorbing. 

Senator McCaskill. Right. 

Ms. Langan-Feirson. And we do not think that they are. We 
know that the FAA is basically capturing what they call OJT costs, 
which those probably are, but we did not see accounting codes that 
would then differentiate and kind of pull out those costs that were 
being self-performed that should have been performed our would 
have previously been performed under the Raytheon contract. 

Senator McCaskill. So, the issue here is this. Complicated train- 
ing, but this is to try to simplify the problem we have. They cannot 
train, under the contract they have been given, do as much work 
as they need to be doing. You ran out of money. You had to start 
the option early, because you guys ran out of money, and you have 
cut staff by, what, 30 percent, that are doing the training? 

Ms. Dugle. At various points in the contract. 

Senator McCaskill. Yes. Well, you have had to cut staff because 
there is not enough money. So, that means that the agency is ab- 
sorbing the costs of doing some of the training that Raytheon is not 
doing now. So, if you are going to recompete this contract, you can- 
not do it unless you figure out what everything costs 

Ms. McNall. Right. 

Senator McCaskill [continuing]. And have any hope that the 
amount you are paying for the contract is the right number. That 
is my sense of urgency here. I am very respectful that this is hard. 
But if you are not even attempting to capture your costs that you 
are absorbing because the contract amount is clearly not correct. 
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then all we are going to have is more of this ad nauseam in the 
future until you figure that out. 

So, is the $250,000 number one I can bank on at this hearing? 
Is that the number it costs to adequately train air controllers in 
the FAA? 

Ms. McNall. That is our best calculation. It is an average figure. 
Keep in mind, individual controllers 

Senator McCaskill. And that includes both Raytheon money 
and the money that the agency is spending? 

Ms. McNall. Yes. In addition, if I may, one of the points, as the 
Inspector General pointed out, was the importance of us tracking 
costs that our controllers are incurring, particularly if they are 
going to pick up training that Raytheon otherwise could have per- 
formed, right. That sheet that we provided you has different cat- 
egories of training put on it. One of those categories is on-the-job 
training, which is the type of training that the FAA controllers 
have always done. That is work that Raytheon has never done, 
and, frankly, it is our anticipation no contractor would be doing, 
right. 

Senator McCaskill. Right. 

Ms. McNall. That is the last step, right. 

Senator McCaskill. Of course. 

Ms. McNall. You will also see a category in there called “Pro- 
ficiency Training.” That is a type of training that Raytheon has his- 
torically performed. That is a type of training that we have moved 
in-house, and there are a number of very good reasons that I will 
be happy to go into if you like, but you will see that we are track- 
ing that cost. 

Another cost is called “Training, Other.” It is under a “Training, 
Other” category that we track the time our controllers spend pro- 
viding training that otherwise would have been done by Raytheon, 
all right. So, we are tracking all those types of costs. 

The other item that the Inspector General quite rightly brought 
up was the potential of overtime. We are continuing to track over- 
time to see if there is any increase or decrease. And, in fact, our 
overtime cost had been, overall, decreasing, and it is less than 1.7 
percent currently. 

So, yes, I fully agree with the Chairman. It is very critical that 
we have a good understanding of our cost and what is the right 
mix to be using between our — when we use a contractor or when 
we are using our own personnel, along with what is the right capa- 
bility and skills that are involved. So, that is engaged. We are 
keenly watching that. 

One of the processes that we have changed since the ATCOTS 
contract was originally awarded was starting to bring the types of 
tools — and I apologize for going on — ^but beginning with the types 
of tools that we have historically used when making capital invest- 
ments or information technology acquisitions to our service con- 
tracts so that we can do that by alternatives analysis. 

Senator McCaskill. Well, that would be — yes, and here is the 
thing. My colleague, who I have a great respect for because I think 
that he would agree with me, it would be a good idea if every mem- 
ber of the Senate has had to make a payroll, it would be a great 
requirement for this job, because I guarantee you, if you were a 
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private business, you would have figured out these costs before you 
had cost overruns of $89 million over a period of just a few years. 
You would have figured it out. You would have figured out whether 
or not it was cheaper or more expensive to have Raytheon be doing 
this and asking for increased contract amounts or whether it is 
more expensive for the government to be doing it. 

To be honest, Ms. McNall, I think you are just now getting your 
arms around that. I think you went years thinking it was not that 
big of deal, and I think that is why we are here, because I think 
if you thought it was that big of deal, you would not have had this 
same major finding in an audit 2 years after the first one, and that 
is what brought us here today. I did not know how else to get your 
attention, because it felt like, to me, that you guys thought we 
were just bothering you, and if you just held on long enough, we 
would go away. 

I can assure you, I am not going away. We are going to get this 
fixed. And when you recompete this contract, I am going to be on 
it like a rabid dog, watching how this works, whether or not you 
have finally figured out what you need and what it should cost, and 
whether it is more cost effective to do some of it in-house and more 
of it through Raytheon or another contractor, whether you have the 
right mix, most of all, if you understand what each different poten- 
tial would cost, and that is what I think really has been lacking. 

I have a few more followups, but I have gone over and I want 
to turn it over to Mr. Johnson. 

Senator Johnson. Apparently, we have a vote called, so I will 
keep this pretty short, but just really second what the Chairman 
has said. It is about information. It is about being able to have the 
tools and being able to make that evaluation as to whether or not 
it is better to do it in-house versus hire an outside contractor and 
who the different contractors are. 

Ms. McNall. Right. 

Senator Johnson. And this is going to just get more complex as 
you move on to more technology. From my standpoint, I would 
think moving forward with technology, particularly in an area like 
air traffic control — I mean, I have watched my son do in-flight sim- 
ulators, amazed at the technology there. So, I would think, being 
a real supporter of the private sector and the innovation of the pri- 
vate sector, I would think the private sector would probably be a 
little more nimble and be able to bring some real technological ad- 
vancements to the training process to actually improve quality, 
which, by the way, that has got to be the first consideration — qual- 
ity, safety. That is the first. I am concerned about cost, but, boy, 
we do not want to compromise quality and safety at all. 

But really taking a look at technology, and only with the infor- 
mation, really understanding what the true internal costs are in it, 
and I recognize that can sometimes be difficult to ascertain, but it 
all depends on how complex it is in terms of the use of personnel. 

So, let me quickly ask that question. Do you have full-time train- 
ers within the FAA? Is that their entire task? Or is this also where 
people have split duties, where they are air traffic controllers at 
some point in time and — I mean, is just gathering that information 
also complex, or is it just that there has not really been the desire 
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within the agency to really make a real push on getting the infor- 
mation? 

Ms. McNall. So, within the agency, we track the time of all of 
our personnel, including our air traffic controllers, which is then al- 
located to a particular cost code. That is one of the things the In- 
spector General 

Senator Johnson. So, you should really have very accurate infor- 
mation in terms of really what the training costs would he inter- 
nally. 

Ms. McNall. And that is the information we have now provided 
to the Committee. 

Senator Johnson. OK. And, again, so you are saying it is about 
$250,000, add to that about $25,000 

Ms. McNall. The $25,000 includes the contractor cost as well as 
the FAA employee cost. 

Senator Johnson. OK. So, it is $225,000 plus about $25,000. 

Ms. McNall. Right. 

Senator Johnson. I mean 

Ms. McNall. Keep in mind, it, generally speaking, takes about 
2 V 2 years to train a controller. 

Senator Johnson. Right. 

Ms. McNall. That will include the training cost of the controller 
who is being trained. Their salaries are also in that 

Senator Johnson. So, to me, the metric — but even then, what is 
the differentiation between full training of a raw recruit versus re- 
fresher? Do you have some sort of sense of that breakout? 

Ms. McNall. Mm-hmm. 

Senator Johnson. I mean, how much are your training costs in 
your annual budget, if it is $360,000 — $360 million, how much of 
that is refresher versus brand new? 

Ms. McNall. So, that is a very shifting number. In fact, that 
was one of the changes, again, that we had not — I hate to go back, 
but if we go back to the length of time to train and why that did 
not improve, the year 2009 was an anomaly, and one of the reasons 
that was an anomaly is because the proportion of that training mix 
was fewer raw recruits and more training of actual controllers in 
place, which is a shorter period of time, so 

Senator Johnson. OK. So, are you tracking it — as long as we 
have this 

Ms. McNall. But we track it all. 

Senator Johnson [continuing]. The tracking code 

Ms. McNall. Yes. 

Senator Johnson [continuing]. So you should be able to say, this 
training was done for refresher. This training was done on new re- 
cruits — 

Ms. McNall. Exactly. 

Senator Johnson. OK. So, my bottom line, and we have to go to 
a vote, is the development of better information, not just for the 
sake of getting information, but actually targeted, and then work- 
ing with the contractor to actually hone in on what — ^because it 
may be a more lucrative contract to Raytheon but save the govern- 
ment money. The total value proposition here is what we are after. 

Ms. McNall. Yes. 
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Senator Johnson. But, you need the information. So, again, I 
just want to second what the Chairman was talking about, is the 
desire and the need for accurate information — ^because, again, read- 
ing through the Inspector General’s report, I just had a lot of ques- 
tions, and there should not be. I mean, we should really have in 
a management information system the kind of detailed information 
that would just really point us in the direction of how we should 
manage this training 

Ms. McNall. Absolutely. 

Senator Johnson [continuing]. Because it is crucial. 

But, with that, I will finish my questioning remarks. Thank you. 

Senator McCaskill. And we have votes. 

Senator Johnson. Yes. We have time here. 

Senator McCaskill. So, I have a little bit more. I would ask your 
forbearance. I am going to run over, vote, and come back. I want 
to talk about the award fees. It is a thing that I care about. I have 
done this, and by the way, you should talk to the folks at DOD on 
award fees and performance fees — Raytheon knows I have been on 
this — about how we do this and whether or not we are using them 
as the tools they should be used, and a few other questions. So I 
am going to run, vote, and come back. It should be 10 to 15 min- 
utes at the max. Thank you. 

Senator Johnson. She is letting you off the hook. Thank you all. 
[Recess.] 

Senator McCaskill. I am so sorry. I will tell you, though, it is 
not lost on me that I sit up here and rail against government agen- 
cies for being inefficient and ineffective and I am a member of the 
U.S. Congress. I just want you to know, I get the joke. [Laughter.] 

This is one of those days that I feel that in a painful way, that 
this is an ineffective and inefficient Congress. 

Let me go through just a few more things I want to make sure 
we get on the record before we close today, and I do not have — we 
have covered most of it. Who would you say is in charge of this pro- 
gram? 

Ms. McNall. So, the person 

Senator McCaskill. You need to turn your microphone on. 

Ms. McNall. So, we have a program manager who works within 
the Air Traffic Organization who is in charge of the program. That 
person reports directly to the Air Traffic Vice President for Safety 
and Technical Training. 

Senator McCaskill. Is there an Air Traffic President? 

Ms. McNall. There is an Air Traffic Chief Operating Officer. 

Senator McCaskill. But then there is a Vice President? 

Ms. McNall. There are several Vice Presidents. 

Senator McCaskill. Weird. 

Ms. McNall. We are a little bit of a different agency. 

Senator McCaskill. That is weird. We do not have Vice Presi- 
dents in government unless his name is Biden. [Laughter.] 

We have it in private companies, but we do not have it typically 
in agencies. So, you would say that the Vice President is the person 
who ultimately has the responsibility for the effective operation of 
this program and the effective use of contracts in support of this 
function? 
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Ms. McNall. He is the one responsible for seeing that air traffic 
controller training is done effectively and efficiently. I am the one 
who is responsible for seeing that the contracts he needs to accom- 
plish that are done appropriately. 

Senator McCaskill. OK. Who do both of you report to, in com- 
mon? 

Ms. McNall. The Administrator. 

Senator McCaskill. So, the boss of this program is really 
Huerta 

Ms. McNall. Always. 

Senator McCaskill [continuing]. Because you have one on the 
programming side, one on the acquisition side, and the only time 
the two of you meet is at the very top. 

Ms. McNall. From an organizational perspective. Now, of 
course, I meet with the Vice President at least monthly, and then 
I have a variety of oversight processes 

Senator McCaskill. But you do not work for him. 

Ms. McNall. No, I do not. 

Senator McCaskill. And he does not work for you. 

Ms. McNall. Correct. 

Senator McCaskill. So, I am trying — I have learned 

Ms. McNall. You are right. 

Senator McCaskill. I have learned the hard way that if you do 
not figure out who is in charge, the chances of you getting some- 
thing fixed go down exponentially. So, you are telling me that, ulti- 
mately, if he is not doing his job or you are not doing your job, the 
only person who can make you accountable is, in fact. Adminis- 
trator Huerta. 

Ms. McNall. That would be correct. 

Senator McCaskill. OK. Let us talk about award and incentive 
fees. What is your understanding of what the contractor had to do 
to get what I think most Americans would call bonuses? 

Ms. McNall. Yes. What the contractors had to do to achieve 
both its incentive fee and its award fee has varied over the period 
of the contract. 

Senator McCaskill. What was the first bonus and incentive fee 
they got? 

Ms. McNall. Right. So, in the first year of the contract, we es- 
tablished a target cost, right. The share ratio on that target was 
50/50. So, for each dollar that the contractor incurred above that 
target cost, reduced his fee by 50 percent. Each dollar below that 
target cost reduced that fee by 50 percent. That first year, because 
of the cost overruns — up to a min and max in each case. So, at 
some point, the fee that he can add to that target is limited, and 
the same thing at the top. As cost growth, he gets a minimum fee. 

The first year, the contractor ended up with the minimum fee. 
The same 

Senator McCaskill. Wait a minute. 

Ms. McNall. Mm-hmm. 

Senator McCaskill. So, he did get the fee that was supposed to 
be incentivizing costs? 

Ms. McNall. He got the smallest amount of fee possible under 
the 

Senator McCaskill. And how much was that? 
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Ms. McNall [continuing]. Contract. Roughly $1.5 million. 

Senator McCaskill. OK. So, he got $1.5 million in a year that 
the cost overruns were $31 million. 

Ms. McNall. Yes. 

Senator McCaskill. Why did he get anything? 

Ms. McNall. When we bid the contract, and this is one thing 
that is always done when you are bidding a cost plus incentive fee 
contract, is — at least in best practices — ^you allow the companies to 
propose back to the government what that target ratio should be, 
and then what the minimum and maximum fees should be, and 
that — you then pick on what you think is the best value for the 
government. In this 

Senator McCaskill. Well, how can it be a value for the govern- 
ment if the cost overruns are $31 million and we still give them 
money for doing a good job on cost? Do you understand that sounds 
weird? 

Ms. McNall. I absolutely understand that sounds weird. It was 
a very small fee for the amount of work done, and the contractor 
was successful in performing the contract. I fully understand, right, 
this was not a controlled cost. I have other contracts where the con- 
tractor will bid and we will agree and write into the contract, there 
is no minimum fee, but that was not this contract. 

Senator McCaskill. OK. The FAA’s award fee contracting guide- 
line — 

Ms. McNall. Yes. 

Senator McCaskill [continuing]. Says no performance element 
should be incentivized more than once. 

Ms. McNall. Correct. 

Senator McCaskill. That is exactly what you did when you of- 
fered Raytheon an incentive fee and an award fee for containing 
costs. Why did that happen? 

Ms. McNall. In all honestly, I was not in this job at the time 
that happened, in their first years of the contract, so I cannot tell 
you exactly what that happened, other than the fact that the agen- 
cy at that point was very interested in controlling cost. As you 
pointed out, we were incurring cost growth and we wanted to bring 
it under control. 

Senator McCaskill. So, there were $14 million in the first 4 
years of the contract in incentive and award fees. Is that a correct 
figure? 

Ms. McNall. Excuse me just a moment. [Pause.] 

Seventeen million in incentive fee and — but more than that in 
the award fee. 

Senator McCaskill. Can you help 

Ms. McNall. Of course, that is going through the first 5 years. 

Senator McCaskill. That is 5 years. 

Ms. McNall. We will be happy to get back to you. 

Ms. Langan-Feirson. During the base period, there were $14 
million in cost incentives and approximately $17 million in award 
fees 

Ms. McNall. Yes. 

Ms. Langan-Feirson [continuing]. For a total of $31 million. 

Senator McCaskill. OK. Thirty-one million. And during that 
same period of time, what were the cost overruns? 
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Ms. Langan-Feirson. The cost overruns were $89 million. 

Senator McCaskill. OK. So, we had cost overruns of $89 million 
and we had two fees that were supposed to he incentivizing costs — 
two incentive and award fees incentivizing costs and they got $31 
million. 

Ms. McNall. That is correct. The award fee incentivized more 
than simply cost control. 

Senator McCaskill. What else did it incentivize? 

Ms. McNall. It incentivized, basically, performance of the con- 
tract. It successfully trained the controllers that we needed to have 
trained. 

Senator McCaskill. And what were the metrics on that? 

Ms. McNall. So, that is where the metrics varied for each per- 
formance period. 

Senator McCaskill. Who decided what the metrics were? 

Ms. McNall. So, the FAA did. 

Senator McCaskill. Well, I thought that Raytheon developed the 
performance metrics early in this contract, that the FAA did not 
do the performance metrics but, rather, they were drawn up by 
Raytheon. 

Ms. McNall. As part of the contract bidding process, each com- 
pany bid metrics, proposed metrics, for the award fees. One of the 
reasons why we asked for them to bid the proposed metrics for the 
award fee was to see how well they understood what the contract 
was aiming for and how good they were at metrics development, 
which would give us a clue as to how good they might be at actu- 
ally achieving those metrics. So, Raytheon bid proposed metrics. 
The FAA changed those metrics before we awarded the contract. 
But we did accept some of them, the basic underlying premise of 
them. 

Senator McCaskill. OK. So, you had a set of metrics before this 
contract was — before you had the competition on this contract, you 
had a set of metrics developed within FAA that you were going to 
measure a contractor by. 

Ms. McNall. In all honestly, again, I was not here at the time, 
so I do not know that we had those metrics prepared. I can tell 
you, I guess, that we did allow the offerors to bid proposed metrics 
to us, and that in this case, before we awarded the contract to 
Raytheon, we accepted some of their metrics and we changed oth- 
ers and that is what went into the contract for the first award fee 
period. Thereafter, the agency established the award fee criteria. 

Senator McCaskill. All right. Do you believe that she has char- 
acterized this accurately, Ms. Langan-Feirson? 

Ms. Langan-Feirson. Senator, we had a great deal of difficulty 
going through the performance measures, because the performance 
measures on this contract varied from period to period. In the be- 
ginning, in our first report, it was reported that some of the per- 
formance measures, Raytheon was assisting with the development 
of the measure. 

But, I will tell you, in the second report, we did look at Award 
Fee Periods 5, 6, and 7 of the base contract and there were essen- 
tially four performance measures, two of them associated with cost, 
that were totally ineffective because the costs kept changing, and 
there was one associated with quality assurance which was rel- 
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atively effective, and then there was the one about staffing effi- 
ciency that we put in the report 

Senator McCaskill. Right. 

Ms. Langan-Feirson [continuing]. Which we did not find effec- 
tive. So, we did not find that the award fee performance measures 
were very effective on the contract. 

Senator McCaskill. And the new fee structure, the new award 
fee structure after the exercise of the option, it is my under- 
standing, Ms. Langan-Feirson, that your report — in looking at your 
report, you saw some conflict there. Could you talk about that? 

Ms. Langan-Feirson. There were five performance measures in 
the first period. We were only able to audit what is called Award 
Fee Period 8, which is the first performance period in the option, 
and there were basically five performance measures. It is the first 
one that was the most troubling to us, which basically required 
that Raytheon deliver the performance work State and the annual 
workplan requirements, but also stay within the cost target. If they 
did not do one or the other, they would fail. If they had an unsatis- 
factory, they would fail all of the other performance measures. So, 
while there might have been other performance measures that 
would have incentivized the contractor, those all went out the win- 
dow if you achieved an unsatisfactory on either one. 

We also felt it was very troubling, because if you met the target 
cost, what essentially happened was you were not delivering 
enough training, and vice-versa. If you delivered enough training, 
you might not have been under the target cost. We did not think 
this was a very effective performance measure. 

Senator McCaskill. And that has got to be really hard for 
Raytheon, because you cannot do both. That is impossible with this 
contract, correct? 

Ms. Dugle. It is correct. What we are trying to do is optimize 
the value of every training dollar, but at some point, we are capped 
on the amount of training that we can deliver due to the con- 
straints of the budget. 

If I may. Senator, I just wanted to clarify or expand upon one 
point that you made. It is obviously factual that Raytheon received 
approximately $31 million in fee over the time period. 

Senator McCaskill. In addition to cost-plus. 

Ms. Dugle. Well, that is the entire fee that we earned, and that 
is what I wanted to clarify, is that it was not a bonus on top of 
any kind of normal fee. It was simply those were the dollars that 
we earned on the work that we did. And I would make the point 
that, yes, the budget, we expended more than was budgeted, but 
we trained between 40 percent more students in year one and in 
net over the 4-year, 20 percent more students. And so it is a bit 
counterintuitive to say the contract was overrun and you are being 
paid fee, but you have to equate it back to the volume of students. 
Otherwise, it would be an unfair burden on a company. 

Since year one of this contract, each year, we sat down with the 
FAA. We target the amount trained and the dollars. And since that 
time, since year one and the 1.5 percent fee that Ms. McNall ref- 
erenced, in years two, three, and four, we have hit our targets and 
we have delivered to those numbers. I bring that forward because 
we are improving progressively as we go and I just wanted to go 
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on record that incentive and award fee is the only monies earned. 
It is not in addition to any other kind of base beyond the program. 

Senator McCaskill. OK; I am confused. So, I thought this was 
a cost-plus contract. 

Ms. Bugle. It is. 

Senator McCaskill. So, you get your costs plus a margin of prof- 
it. 

Ms. Bugle. We get our costs plus an incentive fee award and an 
award fee. Those comprise our fee. 

Senator McCaskill. So, both the incentive fee and the award fee 
are the only things that you are getting above your costs? 

Ms. Bugle. Yes, ma’am. 

Senator McCaskill. So, this is not a cost-plus-award contract. 
This is just a cost plus incentive fee or award program. 

Ms. McNall. Yes. 

Ms. Bugle. Yes. 

Senator McCaskill. Oh, OK. Well, that makes a difference. 
Well, you guys need to redo this. This is a mess, because it is too 
hard — all of it is counterintuitive. You all are being asked to train 
X-amount of people on not enough money to do that. You all are 
absorbing all the costs that they cannot do without really having 
a handle on what that is costing you every year. And, meanwhile, 
the only way they make any profit on them is giving them award 
and incentive fees for holding down costs when you have paid them 
more than the contract was worth most of the years they have had 
the contract. And you wonder why people shake their head. I mean, 
we have to do better at this. 

So, are you ready with performance metrics for the rebid? 

Ms. McNall. We have not yet decided whether or not we will 
use performance metrics for the rebid. One of the concerns we have 
is exactly what you have raised. We have had a great deal of dif- 
ficulty of establishing good award fee criteria and a question of — 
incentive fee works absolutely wonderful if we can hold the target 
cost accurately, right, so there are no changes to the contract. 

Senator McCaskill. Right. 

Ms. McNall. If I cannot do those two things, then I have to 
question whether or not I should do either an award or incentive 
fee. 

Senator McCaskill. So, what is wrong with price certain? You 
know the different kinds of training, right? You may not know how 
much you are going to do in each category, but you are going to 
have just as much luck predicting that as you have had predicting 
everything through this whole contract. What is wrong with a price 
certain? 

Ms. McNall. So, what we are considering is a combination of 
firm fixed price, for example, possibly for the Academy training — 
this is not to say we have made any decisions, and, of course, I do 
not want to give any — too much advance information that I have 
not otherwise released to 

Senator McCaskill. Well, I think people, if you are in this hear- 
ing room 

Ms. McNall. Yes. 

Senator McCaskill [continuing]. They know I like price certain 
a lot better than cost-plus. 
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Ms. McNall. And I fully agree with you. So, mixed with a time 
and material contract is what we are looking at. 

Senator McCaskill. So, do you think that you all are prepared 
on the innovation front? Do you think it is realistic that you can 

f et real innovation with 2 percent? I think $16.7 million of the 
859 million that has heen spent was spent on innovation. Do you 
think that is a realistic percentage to actually achieve innovation? 

Ms. McNall. No, I do not. The reality is the agency does not cur- 
rently have the budget we would need to do the innovation that we 
know we need to do. Long-term with the innovation, it will save 
the agency money. 

Senator McCaskill. Right. 

Ms. McNall. We also know that. It is short-term funding that 
I am struggling to find. 

Senator McCaskill. What was going on internally, after the IG 
made the recommendation to assess the long-term outlook of the 
ATCOTS program, prior to exercising the option? Why was that 
recommendation ignored before you exercised the option? What was 
going on internally that caused that particular recommendation to 
be set aside? 

Ms. McNall. With the greatest respect, actually, we took the 
recommendation very seriously. So, before we exercised the option 
on the contract, we asked ourselves the following questions. Do we 
now have enough basis to understand what our training require- 
ment is? Do we understand it well enough that we can establish 
a target cost? And can we now manage this contract like a perform- 
ance-based contract rather than the level of effort contract, which, 
in all honesty, for the first few years of the contract, we treated it 
much more like a level of effort contract than performance-based. 

At the same time, our No. 1 priority is always safety and effi- 
ciency, so the one thing we knew we could not let drop is that 
steady rate of training. We need that rate of training to continue 
without interruption. So that was No. 1. 

Then it became a question of, well, what is the best vehicle? 
What is my best acquisition vehicle to get to the spot I need to be 
right now, right, as we are using money, and then where do I want 
to go in the longer term? 

Senator McCaskill. Could you speak to what you think, Ms. 
Langan-Feirson, in terms of the exercising the option? It appears 
from the outside that it looked like that they just decided to ignore 
it, but you have spent a lot more time inside this agency than, ob- 
viously, I have. I want to get your take on what you think occurred. 

Ms. Langan-Feirson. I think the most troubling thing for us 
was that in our first report, we basically recommended that FAA, 
after the first couple of years of the overruns, get their arms 
around this. So, we gave them forewarning. Three years later, OK, 
they were backed up against the wall in contract year four. Eight 
months in, they were almost at 80 percent of the contract ceiling 
and they did not have very much time. They basically briefed a 
business case up the chain and the business case was, we are out 
of time, OK. They did not have many options left. This was due to 
lack of advanced planning, plain and simple. That is what was 
going on. 
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Senator McCaskill. I have other questions, but you have waited. 
I have had you here for a long time, especially in light of the fact 
that I had to leave and do votes. Do you feel like that — ^you have 
been there since when, Ms. McNall? 

Ms. McNall. 2011. 

Senator McCaskill. And what part of 2011? 

Ms. McNall. January. 

Senator McCaskill. OK. So, you now have three full years. 

Ms. McNall. Yes. 

Senator McCaskill. Do you have the adequate resources and the 
expertise available to you that you can plan for this next competi- 
tion in a way that the recommendations that have been made in 
two different IG reports will be fully embraced? 

Ms. McNall. Yes. 

Senator McCaskill. OK. That is the answer I wanted. That 
means we have had success. I thank you. 

I thank all three of you. I think you are all strong, competent, 
smart women that are working hard at the task you have been 
given and I hope that you understand that I am weird. I like con- 
tract oversight, and this is, as you know, I do this in many agen- 
cies. 

Somebody said something, because I have been on the FAA about 
electronic devices, somebody tweeted me today, “What’s up with 
you and the FAA?” I said, well, I just love the FAA. [Laughter.] 

I hope I have as much success with the rebidding of this contract 
next year as I had with finally allowing us all to use our electronic 
devices when we take off and land. 

So, thank you very much, and we will get you more questions for 
the record. 

Ms. Dugle. Thank you. Senator. 

Ms. McNall. Thank you. 

[Whereupon, at 4:36 p.m., the Subcommittee was adjourned.] 
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Chairman McCaskill, Ranking Member Johnson, and Members of the Subcommittee: 

Thank you for inviting me here today to testify on the Federal Aviation Administration’s 
(FAA) $859-million Air Traffic Control Optimum Training Solution (ATCOTS) contract. 
The contract was intended to provide up to 10 years of support to train approximately 
17,000 new air traffic controllers FAA planned to hire. However, since the contract was 
awarded in September 2008, we have identified significant weaknesses that undermine 
efforts to meet three key ATCOTS goals: reduce training costs, reduce training time, and 
leverage training innovations to make the training program more efficient In addition, 
FAA exhausted the contract’s 5-year base funding 1 year earlier than plaimed after 
experiencing cost overruns totaling about $89 million. 

Our reviews have identified four primary weaknesses that imdermine FAA’s efforts to 
achieve its ATCOTS training goals and to maintain a sufficient cadre of fully trained air 
traffic controllers. Those weaknesses concern (1) training requirements, (2) training 
iimovations, (3) use of award and incentive fees, and (4) contract oversight. 

IN SUMMARY 

FAA has yet to clearly define its controller training requirements for the ATCOTS 
contract, including the number of controllers who will need to be trained and the types of 
training needed. Without clearly defined training requirements, FAA cannot develop 
realistic estimates of its controller training costs or hold the contractor accountable for 
desired outcomes. FAA also has not provided sufficient contract funding for training 
innovations — even though the contractor’s proposal was dependent on training 
innovations to stay within proposed costs, which were 29 percent lower than FAA’s 
estimates. Further, FAA paid over $17 million in award fees and $14 million in incentive 
fees that were not effective in motivating the contractor to achieve desired outcomes. 
While FAA has taken certain actions to improve program and contract oversight — such 
as implementing a tool to better prioritize where training is needed and consolidating 
training operations under one office — ^FAA has not adequately maintained ATCOTS 
contract files or effectively communicated with contract oversight staff at air traffic 
facilities regarding contract management issues, such as instructor staffing reductions and 
program office roles and responsibilities. 


BACKGROUND 

ATCOTS is a performance-based' contract that includes cost-plus-incentive-fee, cost- 
plus-award-fee. and firm-fixed-price components. The contract consisted of a 5-year base 


* Performance-based contracting lets Government agencies acquire sendees using contract that define what is to be achieved, not 
neewsarily how the work is done. The idea is that contractors have the fieedom to define how they wiil achieve the objectives, 
which allows them to use innovative approach^. 
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period, worth $437 million, and two option periods (a 3-year period and a 2-year period), 
worth $422 million. The ATCOTS contract outlines six key training goals: (1) improve 
quality and consistency of training, (2) reduce training costs, (3) reduce training time, 
(4) leverage best practices and iimovation to provide comprehensive training, (5) develop 
flexible training that can be adapted to meet changing requirements, such as new Next 
Generation Air Transportation System (NextGen) systems, and (6) develop flexible 
training that can be adapted around candidate competencies. 

Under the terms of the contract, the contractor provides classroom and simulator 
instruction, course and curriculum development, and administrative and program support 
services at the FAA Academy and air traffic facilities nationwide primarily for new and 
developmental^ controllers. The contractor also provides proficiency and specialized 
training to Certified Professional Controllers (CPC).^ In addition, the contractor must 
train Certified Professional Controllers in Training (CPC-IT) — controllers who are 
already certified but require site-specific training when they transfer to different facilities 
or move to different areas within a facility. FAA retains control for the overall training 
program as well as for recruiting and hiring controller candidates and conducting on-the- 
job training'' at air traffic facilities. 

In September 2010, we reported that FAA’s weak acquisition practices — ^including a 
failure to clearly define requirements and a lack of effective contract oversight — 
contributed to cost overruns of $46 million in the first 2 years of the program.’ At the 
Chairman’s request, we initiated a follow-up review of the ATCOTS contract. In our 
report issued in December 2013,’ we determined that FAA exhausted the contract’s 
5-year base funding after 4 consecutive years of cost overruns totaling about $89 million. 
As a result, 1 year of training support was eliminated from the contract. During our audit, 
we met with the FAA Acting Administrator in July 2012, to discuss our concerns that the 
contract was about to run out of funds. FAA ultimately exercised the first 3-year option 
period to continue training; however, FAA did not evaluate its additional training 
requirements for that period. 


^ Developmental controllers are newly hired controllers that have graduated from the FAA Academy and been assigned to air 
traffic facilities for field training (classroom and lab instruction and on-fiie-job training). 

^ CPCs are controllers have been certified on all areas within their assigned location. 

On-the-job training occurs when a developmental controller is directing live traffic one-on-tme with a CPC. This training begins 
after develqjmental controllers con^ilete ATCOTS-related classroom and simulator training. 

* FAA ‘s Air Traffic Controller Optimum Training Solution Program: Sound Contract Management Practices Are Needed To 
Achieve Program Outcomes (OIG Report Number AV-20i0-l26), S^t. 30, 2010. 

^ FAA Needs To Improve ATCOTS Contract Management To Achieve Its Air Traffic Controller Training Goals (OIG Report 
Number ZA-2014-01 8), Dec. 18,2013. 
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LACK OF WELL-DEFINED TRAINING REQUIREMENTS CONTINUES 
TO IMPEDE FAA’S EFFORTS TO ESTIMATE COSTS AND REDUCE 
TRAINING TIMES 

Since ovir September 2010 report, FAA has taken some steps to better assess training 
needs, such as use of enhanced program management tools to better prioritize where 
training is needed. However, FAA has yet to clearly define its controller training 
requirements or determine the number of controller training hours needed — 
recommendations we made in 2010.^ Without clearly defined training requirements, FAA 
cannot develop realistic estimates of its controller training costs or hold the contractor 
accountable for desired outcomes. The lack of well-defined requirements has also 
contributed to increases in the time it takes to train controllers. 

FAA Has Yet To Clearly Define Its Controller Training Requirements 

Within the first year of the ATCOTS contract, it became clear that FAA had greatly 
underestimated its developmental and CPC training needs and had not anticipated the 
impact of new training requirements, such as those needed for the introduction of new 
NextGen systems into the National Airspace System. For example; 

• During the first year, the ATCOTS contractor estimated that a total of 
5,620 developmental controllers needed training — 41 percent more than FAA’s 
original pre-award estimate of 4,000 total developmental controllers. As a result, the 
contractor was required to train significantly more controllers than expected; 

• FAA’s original reqtiirements did not quantify the number of CPC-ITs who required 
training. Over 600 CPC-ITs required training in 2009 — a number that grew to over 
1,100 in 2012 — ^which increased the number of training hours the contractor was 
expected to provide. 

Consequently, the ATCOTS contract costs grew by 35 percent during the first year alone. 
However, FAA has still not yet clearly defined its total controller training requirements. 
For example, the ATCOTS contract requires the contractor to provide proficiency 
training on both new and existing air traffic controller systems,* but FAA has not 
quantified these requirements. As a result, the contractor’s proposal did not include 
sufficient training hotus for new systems — such as the En Route Automation 
Modernization, a key NextGen program — ^which required 77,736 hours of training during 
the first contract year. 


’ Specificaily, we recommaided that FAA d^ermine (1) if the existing contract mechanism could be elFectively modified to 
achieve ATCOTS program goals within the original contract estiinate of $859 million or (2) update the cost estimates and 
requirements for its training needs and develop criteria for determining whether the Agency should exercise opti<His in the 
contract 

® These systems include En Route Automation Modernization, Standard Terminal Automation Replacement System, and 
Automatic Dependent Surveillance-Broadcast. 
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In September 2010, we reported that FAA’s Annual Work Plan (AWP) — a tool for 
identifying and reporting training needs to the contractor — did not adequately capture 
FAA’s training requirements. Since we issued that report, FAA has established additional 
controls to better capture training requirements. For example, FAA has improved its 
AWP, which now defines the number and types of students, student training levels, 
training locations, and the dates by which students must be trained. FAA also created a 
tool to better verify training hours being incurred at individual air traffic facilities. 
However, the AWP still does not capture all of FAA’s training requirements, such as 
proficiency training requirements for both new and existing systems. Without a sound 
AWP or clearly defined training requirements, FAA remains at risk for underestimating 
its training costs. 

Increases in Training Requirements Have Contributed to Cost Overruns 

Without clearly defined requirements that include all of FAA’s air traffic controller 
training needs, FAA could not develop a realistic estimate of its training costs to ensure 
that sufficient funding is available for training. For 4 consecutive years, ATCOTS 
experienced cost overruns totaling about $89 million, which exhausted the contract’s 
5-year base funding in 4 years. Specifically, FAA chose to exercise the contract’s first 
3-year option period 1 year ahead of time to continue training support when the base 
period funding ran out, reducing the contract’s total performance period by 1 year. 

To limit future cost overruns on the ATCOTS contract, the contractor reduced contractor 
training staff by about 44 percent — fi'om 1,312 to 738 employees — ^between September 
2008 and August 2012. To compensate for this reduction, FAA plans to increase the 
amount of internal training performed by CPCs. FAA acknowledged that the contractor 
can provide training at a lower cost than CPCs, who are paid higher salaries than 
contractor staff. In addition, internal training may also lead to increases in CPC overtime 
pay. CPC overtime costs can include overtime hours for CPCs conducting training as 
well as overtime hours for CPCs taking on the controller responsibilities of those taken 
off the floor to conduct training. 

However, FAA does not account for its total internal training costs. For example, FAA 
only tracks costs associated with time CPCs spend conducting on-the-job training. FAA 
does not account for the costs of using CPCs to conduct classroom and simulator training 
or the associated backfill overtime costs to replace CPCs on the control room floor. As a 
result, FAA cannot truly assess whether there might be a more cost-efficient way to 
provide training to its air traffic controllers. 
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Controller Training Times Have Signiflcantly Increased 

Between fiscal years 2009 and 2012, the time to certify controllers increased by an 
overall average of 41 percent — ^taking 9 months longer on average to certify each 
controller. While average training times are the longest at en route facilities,® certification 
times increased the most at terminal facilities, with an average increase of 57 percent, or 
almost 11 months longer on average to certify controllers (see figure 1). 

Figure 1. Average Time To Certify Controllers Between Fiscal Years 
2009 and 2012 



Source: FAA training data 

Air traffic and training managers attribute the increased training times to decreased 
contractor support; increases in training requirements, including training related to 
airspace redesign and new technology; and increased proficiency training and refresher 
training for CPCs in response to changes in regulations. 

FAA facility managers we spoke with also warn that contractor staffing reductions may 
further increase training delays. While officials from FAA’s ATCOTS program office 
told us diat lower hiring and retirement rates have reduced the Agency’s overall training 
needs, more than half of the managers at 13 air traffic facilities we contacted believe they 
do not have the capacity to provide internal training, given current staffing levels and 
workload demands. Further, FAA has not collected data on whether facilities have the 
capacity to provide training, especially at high-traffic facilities. If CPCs are not 
immediately available to teach, there may be training backlogs. 


’ En route facilities manage high-altitude air traffic. Terminal teilities vaiy in coinilexity and manage air traffic in and around 
airporte. 
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TRAINING INNOVATIONS INTENDED TO REDUCE COSTS HAVE NOT 
BEEN ACHIEVED 

FAA’s independent Government cost estimate determined that the 10-year ATCOTS 
contract would cost $1.2 billion — ^nearly $358 million, or 29 percent, more than the 
contractor’s proposed costs. To close this gap, the ATCOTS contractor planned to 
implement training irmovations — such as pilot programs for new capabilities to reduce 
training time and cost, and a proposed “hub and spoke” system to provide services at 
multiple locations. 

Prior to award, FAA’s technical management evaluation team determined that the 
contractor’s proposed costs were unrealistic and concluded that there was a 60- to 
80-percent likelihood that training needs would not be achieved. However, FAA’s source 
selection board did not require the contractor to revise its proposal and ultimately 
determined that the contractor could overcome weaknesses in its proposed approach. 

However, FAA budgeted less than 2 percent of the ATCOTS base contract value for 
training innovations — a key factor for reducing costs. The contractor’s lower bid was 
based on the assumption that it could reduce training hours by 30 percent by 
implementing training innovations. In practice, the $16.7 million that FAA dedicated for 
training innovation proved insufficient to adequately implement the contractor’s 
innovation ideas. According to the contractor, FAA rejected the majority of the 
1 1 proposals it submitted for training innovations. FAA officials told us that the 
contractor’s process improvement and training innovation proposals were technically 
deficient and too costly. Instead, FAA used most of the budget associated with innovation 
to implement the Agency’s irmovations rather than the contractor’s. 

The lack of training innovations is particularly problematic given the need to make large- 
scale, technological improvements to the training program and train controllers on future 
NextGen technologies. FAA facility managers stated that the introduction of NextGen 
technolo^es has substantially increased controller training requirements. Without 
training innovations that can be adapted to new technologies, the arrival of future 
NextGen systems may lead to additional training backlogs. 
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FAA HAS NOT EFFECTIVELY USED AWARD AND INCENTIVE FEES TO 
HOLD THE CONTRACTOR ACCOUNTABLE FOR ACHIEVING DESIRED 
OUTCOMES 

FAA has not leveraged contract incentives to hold the contractor accountable for 
achieving desired outcomes. Specifically, FAA paid the contractor over $17 million in 
award fees and paid another $14 million in incentive fees despite 4 consecutive years of 
cost overruns totaling about $89 million. 

The ATCOTS contract allows the contractor to earn both incentive fees and award fees 
for containing costs, a practice that is inconsistent with FAA’s Acquisition Management 
System (AMS) guidance. AMS states that care must be exercised to ensure that 
combinations of cost-control award and incentive fees do not result in contractors making 
trade-off decisions inconsistent with FAA’s objectives. In addition, FAA’s Award Fee 
Contracting Guidance states that no performance element — such as cost— should be 
incentivized more than once. Contrary to its guidance, FAA paid the contractor 
$5 million in cost-related award fees and $14 million in incentive fees despite 
4 consecutive years of significant cost overruns. The incentive fees were not effective at 
controlling costs because FAA continually increased target costs. However, FAA’s AMS 
states that an incentive fee should only be used when a reasonable and attainable cost 
target can be established. 

In addition to cost-related award fees, the Agency paid another $12.3 million in award 
fees that were intended to motivate the contractor to achieve FAA’s training goals but 
sometimes forced the contractor to make trade-off decisions inconsistent with other goals. 
For example, FAA paid the contractor a portion of the award fee for meeting a 
performance measure related to staffing efficiency, which called for the contractor to stay 
within a set range of staffing hours. However, the contractor stated that it was not 
motivated to optimize staffing or lower staffing costs because any efforts to reduce 
staffing below the set range of hours would have lowered its award fee in this category. 

In September 2012 (the beginning of the first option period), FAA introduced a new 
award fee stmcture for controlling costs that requires the contractor to make trade offs 
that defeat the contract’s larger goal of providing sufficient controller training. 
Specifically, the new structure provides that FAA will not pay the contractor any award 
fees if (1) contract costs exceed the cost target or (2) the contractor does not deliver 
sufficient training. However, in April 2012 the contractor decreased its insbractor staffing 
to avoid exceeding cost targets and, therefore, could not provide sufficient training 
support. As a result, FAA did not pay the contractor an award fee for any performance 
measure for this period. This represents an ineffectively designed measure because it 
offset the ability to motivate the contractor to achieve various quality, cost, and schedule 
objectives for the contract. Specifically, if the contractor pays the amount needed to 
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ensure training levels, then it is penalized for exceeding cost targets. Conversely, if the 
contractor remains vsrithin cost targets, then it is penalized for not meeting training 
levels. An effective contract award structure requires each contract goal to be separately 
measured and incentivized without impeding the achievement of other measures. 


FAA HAS NOT PROVIDED ADEQUATE CONTRACT OVERSIGHT 

While FAA has taken certain actions to improve program and contract oversight, such as 
implementing a tool to better prioritize where training is needed and consolidating 
training operations under one office, oversight weaknesses remain. Specifically, FAA has 
not adequately maintained ATCOTS contract files or effectively communicated with 
FAA contract oversight staff at air traffic facilities who help manage the contract. 

In September 2010, we reported that FAA did not have controls to ensure it received 
services billed by the contractor. During the first year of the contract, the ATCOTS 
program office authorized payment for 11 contractor invoices, totaling $45 million, 
without the FAA Academy verifying whether the services billed were actually provided. 
Since our 2010 report, FAA has made some improvements to its oversight controls and 
contract administration. For example, FAA reorganized and consolidated training 
operations under one office and implemented a tool to better prioritize where training is 
needed. In addition, an FAA program representative stated that the Agency has 
implemented the following improvements in contract management: 

• Implemented performance and cost boards to monitor contractor performance; 

• Required the contractor to provide more detail about the costs incurred, improving 
invoice review procedures; and 

• Required the contractor to reorganize its management structure to reduce inefficiency. 

Despite these reported actions, other weaknesses persist. For example, FAA has not 
adequately maintained contract files, which exist in two separate locations and do not 
contain a complete history of all contract actions. Complete contract files allow newer 
staff to readily access and imderstand the contract’s complete history, which has proven 
especially important for ATCOTS given the high turnover in critical program staff that 
the program has experienced. Since September 2010, FAA has completely re-staffed its 
ATCOTS program office and contract management office. In total, the ATCOTS 
program has had four program managers, six contracting officers, and eight contracting 
officer representatives since the contract award, making it all the more critical to have 
complete contract files. 


FAA’s ATCOTS program office depends on FAA contract oversight staff at individual 
air traffic facilities to help manage the contract, but during this review we determined that 
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the program office does not effectively communicate with the facilities or provide 
adequate oversight on matters such as staffing reductions and expectations about program 
office roles and responsibilities. Many facility managera did not know who managed the 
ATCOTS program and were not always provided vrith detailed guidance. Moreover, 
FAA’s ATCOTS program office did not enforce the requirement that FAA contract 
oversight staff conduct semi-annual evaluations of the contractor’s performance. The lack 
of evaluations prevents the program office from identifying problems and taking 
appropriate corrective actions. 

Finally, FAA has yet to perform an integrated baseline review (IBR) of the ATCOTS 
program, despite cost overruns and limited training delivery. An IBR can help agencies 
pinpoint problems and make decisions on the amount of services required and additional 
funding needed to obtain them. Specifically, an IBR examines whether (1) all program 
requirements have been addressed, (2) all risks have been identified and appropriate 
mitigation plans are in place, and (3) planned resources are sufficient to complete the 
work. Without an IBR, it will be difficult for FAA to determine whether it can achieve its 
air traffic controller training goals under the current ATCOTS contract. 

Last month, we issued our audit report updating the status of the ATCOTS contract In its 
response to our report, FAA generally agreed with om recommendations and stated that it 
has begun taking actions to address them. For example, FAA stated that it rolled out a 
new training planning tool and designated two quality reliability officers to provide 
surveillance. However, we are requesting further information from the Agency to verify 
whether these actions meet the intent of our recommendations. Additionally, FAA 
announced that it plans to award a new contract to replace ATCOTS as early as fall 2014. 
To avoid repeating the problems with ATCOTS, FAA will need to ensure that it 
completes an IBR and clearly defines its training requirements before awarding the new 
contract — one of the recommendations from our December report. Since FAA recently 
stated its intentions to address our report recommendations, we will continue to monitor 
FAA’s progress in implementing them and provide this Committee, the Secretary, and 
FAA with future updates on the ATCOTS program. 

That concludes my statement Chairman McCaskill and Ranking Member Johnson, I will 
be happy to answer any questions you or the other Members of the Subcommittee may 
have. 
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STATEMENT OF PAT MCNALL, ACQUISITION EXECUTIVE, FEDERAL AVIATION 
ADMINISTRATION, BEFORE THE COMMIITTEE ON HOMELAND SECURITY AND 
GOVERNMENT AFFAIRS, SUBCOMMITTEE ON FINANCIAL AND CONTRACTING 
OVERSIGHT, ON MANAGEMENT OF AIR TRAFFIC CONTROLLER TRAINING 
CONTRACTS, JANUARY 14, 2014. 

Chairman McCaskill, Senator Johnson, members of the Subcommittee; 

Thank you for the opportunity to speak to you today about the management of air traffic 
controller training. A well-trained and fully-staffed air traffic control (ATC) workforce plays an 
essential role in folfilling the Federal Aviation Administration’s (FAA’s) duty to ensure aviation 
safety. The FAA’s most recent controller workforce plan calls for approximately 14,900 air 
traffic controllers in 2014. Controllers work in air traffic facilities of varying sizes, safely 
guiding tens of thousands of aircraft through the National Airspace System (NAS) each day. 
These employees provide air navigation services to aircraft in the U.S. domestic airspace and in 
the 24.6 million square miles of international oceanic airspace delegated to the United States by 
the International Civil Aviation Organization. Air traffic controllers are critical to the 
management and separation of air traffic and the safety of our entire system. 

The A TCOTS contract and the need for A TC training 
Following the air traffic controller strike in 1981, the FAA hired a large number of controllers to 
replace the previous workforce. By 2005, the FAA faced a unique staffing situation and a 
profound challenge; more than 70 percent of the ATC workforce would become eligible to retire 
over the next decade. At the same time, there was an increasing demand for air travel. The FAA 
projected that it would be necessary to hire and train approximately 17,000 new air traffic 
controllers over the next ten years (by 2015) in order to meet these challenges. In addition, the 
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environment for ATC training was changing due to the FAA’s efforts to improve training and 
modernize the NAS, in part by implementing technological enhancements under the Next 
Generation Air Transportation System (NextGen). 

To manage this large training effort, the FAA proposed replacing two existing level of effort 
training contracts with one performance based services contract. In February 2008, the agency 
began soliciting offers for the Air Traffic Conttol Optimum Training Solution (ATCOTS) 
contract. The ATCOTS contract was designed to provide supplemental training support for new 
and existing air traffic controllers. The agency set out to ensure that high levels of safety and 
operational excellence in the air traffic control system continued while it created a cost-efficient 
air traffic controller training process and trained enough controllers to meet the agency’s 
burgeoning needs. 

In September 2008, after running a full competition, the FAA awarded the $859-million 
ATCOTS contract to Raytheon Technical Services Corporation (Raytheon). Under this contract, 
Raytheon was to assist in modernizing the FAA’s air traffic controller training program and 
provide training support for new and existing controllers. In the early years of the contract, 
however, we encountered significant challenges and cost overruns. At the time, the FAA was 
facing the challenge of transitioning from two separate contracts for training support (one 
providing support to the FAA Academy and the other providing support for on the job and field 
training at over fifty facilities nationwide) to the FAA’s first-ever Performance-Based contract 
for air traffic training. FAA’s management was focused on maintaining system safety and 
training continuity, so the FAA required Raytheon to provide the same level of services as the 
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prior contractor and, consequently, prescribed performance levels that exceeded Raytheon’s 
proposal (and proposed costs). And, because of a rapidly changing training environment, the 
FAA underestimated the foil scope of training requirements. 

These issues contributed to higher-than anticipated costs and led Congress to direct the OIG to 
initiate an audit of ATCOTS in early 2009. In August 2010, the Office of Inspector General 
(OIG) released its first report. The OIG made nine reconunendations, eight of which had been 
completed by the time the OIG conducted a follow-up review in 2012 and 2013. The OIG issued 
its most recent report last month. The latest OIG report contained ten additional 
recommendations; the FAA concurred with nine of the recommendations and concurred in part 
with one. 


FAA continues to improve ATCOTS administration 
The FAA has readily acknowledged that we faced challenges in executing the ATCOTS contract, 
particularly in the early years. We recognized that we must implement new measures and 
controls to ensure that the benefits of ATCOTS are realized without undue cost to the 
government. We have taken significant steps to improve the ATCOTS contract management, 
oversight, and maintenance of costs. I’d like to highlight a few of the improvements we have 
made in recent years. 

The FAA consolidated training under the Office of the Vice President of Safety and Technical 
Training in order to bring increased management attention to the training program. The goal of 
this new organization was to improve overall program management. It implemented a new 
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management framework, which provided the vision, metrics, strategy, and accormtability needed 
to meet the needs and expectations of the FAA. 

There were cost overruns in the early years of the ATCOTS contract. In contract year one, costs 
exceeded the yearly projected ceiling by 35% and in contract year two by 33%. The pace of 
grovrth was reduced in years 3 and 4 due to the implementation of stronger contract management 
controls. During the fourth year of the contract, the FAA was faced with a decision: to 
determine whether there was a valid single source basis to negotiate an increase to the contract 
ceiling due to the initial cost overruns or to issue a new sole source bridge contract, or to exercise 
the first 3-year option and not exceed the total contract ceiling over the 10-year contract period. 
The FAA decided to not raise the ceiling and live within the total limits of the contract, to 
exercise the option one year early, and to implement significant adjustments to the existing 
contract. This option provided the best cost protection for the Government. It also allowed the 
FAA have necessary training continue and avoid potential cost growth to other programs that are 
dependent on the ATCOTS contract, while the FAA prepared for a possible competition to 
replace the ATCOTS contract. 

The FAA recently issued a market survey as the first step toward a possible replacement of the 
ATCOTS contract. It is possible that we will end the ATCOTS contract and replace it with a 
new competitively awarded contract before the end of this calendar year. If the FAA determines 
that the existing ATCOTS contract offers the FAA the best value for these services, as compared 
to any offers that might be received for a replacement contract, the FAA may choose to exercise 
the last option period under the ATCOTS contract But, before doing so, we will verify the 
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continued need for the training services, ensure sufficient funds are available, and evaluate 
whether the contractor’s performance is satisfactory. 

In August 2012, the FAA implemented the use of a more precise Annual Work Plan and 
enhanced program management tools to better prioritize its training needs and ensure that we 
have timely and accurate cost estimates. White the FAA updates the cost estimate for ATCOTS 
on an annual basis, it also receives monthly updates to ensure that we are continually responsive 
to the changing needs of the agency. The very nature of training means that it is somewhat 
dynamic, since trainees will proceed through the course at various speeds and with varying 
needs. We are, therefore, constantly assessing our needs and determining oiu requirements. We 
now do that in 30-day periods to allow for both precision and flexibility in executing the 
contract. 

With the cooperation of Raytheon and in coordination with the Office of the Inspector General, 
we restructured how the FAA measures performance and renegotiated the complete set of 
Acceptable Performance Levels. Those went into effect in September 2012. The renegotiated 
APLs were crafted to motivate the service provider to improve quality and consistency of 
training delivery, reduce the time to train, and leverage best practices and innovation within the 
yearly target cost, which are all consistent with the contract goals. In addition, the current 
contract calls for a cap on awards and does not allow the service provider to maximize the 
incentive fee unless the acceptable performance levels and associated performance measures are 
also maintained. Raytheon is not eligible for any increases in incentive fee if the contractor does 
not receive at least a “Satisfactory” rating in all award fee determinations made during each 
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individual six-month performance period. In other words, maintaining quality and cost controls 
are now linked under to the contract structure and Raytheon does not get the financial reward of 
meeting one without meeting the other. 

We have also implemented a new process for defining monthly requirements and improved 
communications with the field and contractor to identify training requirements, schedules and 
resources. In August 2013, the FAA ATCOTS Program Office, in collaboration with Raytheon, 
developed, completed and rolled out a new training planning tool for use where ATCOTS 
services have been deployed in the field. This training planning tool; 

o integrates the Rolling Wave Planning Book; the Training Staffing Support Plan 
(TSSP) incorporates training schedules 

o identifies resources by category for budget planning to support training 
requirements in the field 

o features a one month look-back (status), current month activities, and a two month 
look ahead and is updated on a monthly basis. 

o identifies developmental, proficiency, certification and recurrent training, and the 
resources required to perform these activities. 

In July 2012, the FAA released a Quality Assurance Surveillance Plan. This plan provides the 
FAA Integrated Product Team with guidelines to monitor required performance standards and 
expected outcomes for the service provider. The FAA Contracting Officer has designated two 
Quality Reliability Officers (QROs) for this contract. The QROs provide surveillance to the 
overall training requirements imder the contract and have the authority to verify that the 
contractor’s quality plan complies with contract requirements. The QROs conduct quality audits, 
setting up quality standards, and ensure compliance with FAA policies and standards. 
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The FAA has also implemented procedures to hold FAA oversight staff accountable for 
overseeing contractor performance at the facilities, including additional training and semi-annual 
performance evaluations. 

These improvements have been instrumental in improving the oversight, management, and 
administration of the ATCOTS program. I am confident that they will continue to yield benefits 
as we move forward with our important efforts to provide quality ATC training at the FAA 
academy and in the field. 


Going forward 

We appreciate the OIG’s thorough review of the ATCOTS contract and we are confident that the 
measures we have taken, which fall in line with the OIG’s recommendations, will allow us to 
stay on track for the remainder of this contract. We continue to assess our staffing needs and 
determine whether it is most advantageous to exercise the remaining option under the ATCOTS 
contract or issue a new contract to meet the agency’s continued ATC training needs. There is no 
doubt, however, that training air traffic controllers will continue to be a critical need for the 
agency as we continue to ensure the safety of our skies. We estimate that the FAA will hire over 
1 1,700 air traffic controllers through fiscal year 2021 and, in order to meet the demands of the 
system and maintain safety, we must continue to hire and train ATCS at a steady rate. 

Decreased funding, including the effects of sequestration, has created an additional challenge to 
our ability to hire and train air traffic controllers. All training comses at the FAA Academy have 
been cancelled since sequestration was implemented and training courses are only resuming this 
month. The FAA was also unable to hire any new air traffic controllers and will have to 


7 



48 


accelerate hiring, pending budget constraints, to ensure that we have a sufficient number of well- 
trained, competent air traffic controllers to handle the high volume of air travel in the national 
airspace. This increased rate of hiring will bring with it increased training requirements, beyond 
what was initially predicted for the coming year. Whenever we face uncertainty about hiring, we 
also face uncertainty about our training needs and it becomes difficult to predict costs and plan 
for the best, most cost-efficient training possible. We remain committed, however, to ensuring 
the safety of the NAS and have not and will not compromise safety, even in these uncertain 
times. 

Ms. Chairman, this concludes my statement. I would be happy to take questions at this time. 
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Testimony of Lynn Dugle 
President, Intelligence, Information and Services 
Raytheon Company 

Before the 

Senate Committee on Homeland Security and Governmental Affairs, 
Subcommittee on Financial and Contracting Oversight 

January 14, 2014 

Good afternoon. Chairman McCaskiU, Ranking Member Johnson, and committee 
members. 

I am Lynn Dugle, President of Intelligence, Information and Services (IIS) for Raytheon 
Company. The business I lead is the prime contractor for ATCOTS, the Air Traffic Control 
Optimum Training Solution program. Thank you for the opportunity to address the 
subcommittee on Raytheon’s management of the program, our ongoing efforts to reduce costs, 
and new training innovations we are bringing to the program. 

Before I do so, let me provide some relevant context on Raytheon. My own IIS business 
is one of the world’s leading providers of mission-critical training solutions. In fact, Raytheon 
trains more than two million people a year whose missions include national defense, U.S 
intelligence operations, cyber security and, of course, national air space management. 

Our training solutions also extend to critical needs in the commercial sector. As an 
example, Raytheon provides one of the world’s largest automobile manufacturers with 
transformational training to ensure vehicle safety and highly cost-effective repair and 
maintenance operations. This particular customer recently renewed our contract, and has been 
able to achieve savings of more than 50 percent while also increasing the training population by 
50 percent. 
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I would also like to point out Raytheon’s position as one of the world’s largest providers 
of air traffic management systems. Our systems control more than two thirds of the world’s 
airspace, and our company is an active participant in the FAA’s NextGEN initiative. We believe 
that our world-class mission critical training capabilities, scale and transformational approaches, 
program knowledge, and familiarity with air traffic management have been important factors in 
our ability to contribute to the ATCOTS program. 

Since this hearing is intended to address the Department of Transportation’s Inspector 
General’s (DOT IG) most recent report on the ATCOTS program, let me say that Raytheon 
agrees vrith the general conclusion of the report that progress has been made in improving the 
program and that more work remains. Raytheon and the FAA have built a partnership that has 
worked at addressing the Agency’s dynamic and unprecedented training needs over the past six 
years. During the last year, we have accelerated progress in making improvements to the 
program, and I strongly believe that we now have a solid foundation for further gains. I can 
assure you that Raytheon remains completely committed to the program and is uniquely 
positioned to provide cost-efficient and effective training of the controllers who operate the 
safest, largest, and most complex air traffic management system in the world. 

Let me now share our thoughts on three topics the committee requested Raytheon cover; 
Management of the Contract: 

As the IG report states, the management of this contract was challenged from the start by 
unexpected increases in cost and scope that were identified after the contract began. This 
included a hiring surge that resulted in a 40 percent increase in the number of trainees (from 
4,000 to 5,600) during the first year of the contract. Raytheon identified the cost of moving the 
larger number of students through the system in our formal cost and performance reviews and 
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went through the normal change proposal process. All of our work was agreed to by the FAA, 
including revised performance measures. 

In addition, there were also higher costs associated with previously unidentified FAA 
training requirements for nearly 700 of these trainees; meeting Air Traffic Control system 
modernization needs; and implementing new tower simulation training. 

Raytheon responded to these challenges and trained 20 percent more individuals during 
the &st four years of the contract than originally anticipated in the program budget. The 
company also lowered the cost per student at the Academy by six percent; decreased the 
controller training failure rate by twelve percent; shortened class durations at the Academy by 10 
percent; and achieved 23 percent more efficient use of costly tower simulators. In addition, we 
received instractor approval ratings of 99.6 percent from the FAA during the last grading period. 
Raytheon has met and continues to meet the training performance requirements and goals 
identified by the FAA. 

Our progress goes beyond the metrics and includes the lessons that both the FAA and 
Raytheon have learned from this experience. These have led to changes in personnel at both 
organizations, and much stronger collaboration on methodology, budgets, trade-off decisions, 
and performance. This was critical to making the adjustments needed to comply with 
sequestration and last year’s government shutdown. 

Cost Reduction in the First Option Period: 

As the committee knows, during the contract’s first four years, total ATCOTS program 
spending exceeded the budget by 20 percent and the FAA decided to initiate the first contract 
option a year early to continue the program’s fimding. 
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Raytheon and the FAA are working to maximize the training that can be accomplished 
within the allocated budget. Let me cover some of the changes we have made. For the first time, 
FAA field managers are involved in deciding local training priorities, which will lead to more 
efficient and effective training across the system. Their involvement has been enabled by a new 
planning and execution tool developed and implemented by Raytheon at our own expense. In 
collaboration with the FAA, we have also implemented new workforce practices and scheduling 
efficiencies at the Academy that are expected to reduce the remainder of FY14 costs by five 
percent. Further, we reduced our program management office by 20 percent after working 
together with the FAA to streamline contractual reporting requirements. This reduction should 
lead to $2 million in annual savings. 

New Training Innovations: 

As the IG report suggests, training transformations that could have had a material effect 
on either cost or certification times have not yet been achieved during the first four years of the 
contract. I agree with that conclusion. Some of the reasons for the lack of progress have been 
the team’s focus on meeting the more immediate mission training needs; addressing expanded 
training requirements; and finding near-term cost efficiencies. That said, Raytheon has provided 
numerous proposals and white papers outlining potential areas for important irmovations. 
Through our Six Sigma process we have found ways to lean out the process and achieve better 
utilization and productivity. With support and approval from the FAA, we could implement 
innovations that would allow us to deliver higher quality training at a lower cost. 

The biggest opportunity now before us is the ATCOTS Curriculum Architecture 
Project, which was started in August, 2013. Raytheon, working in collaboration with the FAA 
and the National Air Traffic Controllers Association (NATCA), created a blueprint for the 
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systematic modernization and transformation of the ATC training program. This strategic 
approach identifies the best training methodology (instructor-led, web-based, simulation, etc.) to 
use for specific training requirements, and how to best sequence training to avoid duplication 
while enhancing knowledge acquisition. This approach is practiced by the leading training 
organizations in the world, and based on our own experience with both commercial and 
government customers, could result in savings of up to 50 percent. While significant up-front 
effort is involved, the architecture project could be a game-changer leading to transformational 
air traffic controller training. 

Other innovations we have presented to the FAA include Virtual Classroom Training 
(VCT), Remote Simulation, and the development of a remote Air Traffic Basics Course. VCT 
would allow a single instructor to deliver training to multiple classrooms at once. The same 
concept can be applied to high-cost simulators, saving on travel time and delivery service costs. 
However, these strategies conflict with various contractual requirements for the instmctors to be 
physically located at each field facility. The FAA is considering the request and the associated 
modifications, along with Raytheon’s plan to ensure instmctors will have the proper knowledge 
and experience for quality instmction. 

The implementation of a remote Air Traffic Basics course also has promise. Instead of 
attending this five week course at the Academy, a new hire would learn the fundamentals, such 
as aircraft identification and runway numbering, and complete this computer-based training prior 
to arriving at the Academy, thereby reducing student and instroctor costs. 

1 would like to conclude by emphasizing that significant progress has been made over the 
past year in this complex, challenging, and critically important program. Raytheon and the FAA 
have established a solid foundation for further performance gains and cost reduction. In the ten 
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months since I have assumed responsibility for the program, it has been become very clear to me 
that Raytheon has the program knowledge, transformational training capabilities, scale, and the 
larger air traffic management domain experience to continue to meet the dynamic needs of the 
FAA while helping to implement beneficial changes. We pride ourselves in being a leader in 
providing affordable and effective mission critical training and we believe we have already 
accomplished much on the ATCOTS program. 

Thank you for the opportunity to speak with you today and I look forward to responding 
to any questions you may have. 

***** 
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Post-Hearing Questions for the Record 
Submitted to Ms. Patricia McNall 
From Senator Claire McCaskill 

“Management of Air Traffic Controller Training Contracts” 

January 14, 2014 

1. During the hearing, the Federal Aviation Administration (FAA) cited $250,000 as the 
average cost to train an air traffic controller, and that 25% of this cost was associated with 
contractor work and 75% was associated with costs to the FAA. 

Q. Please clarify what the $250,000 averages covers, and the average amount of time this 
cost is based on. 

A. That figure is based on a study conducted by Grant Thornton under contract to the FAA. ' 

At the time of the hearing, Ms. McNall believed that this figure included the total cost of training 
delivered by FAA personnel and by the ATCOTS contractor (Raytheon). The FAA wishes to 
correct the record on that point. That figure does not represent the total average cost to train a new 
controller. Rather, it represents the salary paid by the FAA while a new air traffic controller is in 
training. It includes the salary paid to a newly hired air traffic controller, as well as the premium 
salary paid to FAA air traffic controllers who train new hires. It is based on an average training 
time of 2.6 years for a new controller. This cost does not include Academy or contract support 
(such as the ATCOTS contract) costs. 

The FAA does not track the training costs associated with individual air traffic controllers. The 
FAA tracks its training costs by category in order to measure the initial costs of training new air 
traffic controllers. Those are reflected in Attachment A. The cost associated with training 
individual controllers varies greatly. And, after initial air traffic controller training at the FAA 
Academy, the training needed by a controller depends entirely on the facility to which he or she is 
assigned, the person’s position at that facility, the specific equipment at the facility, and the 
specific airspace for which the controller will be responsible. All of those factors impact the 
amount it costs to train an individual air traffic controller. 

As Attachment A reflects, approximately 22% of the initial costs associated with training a new air 
traffic controller are attributable to the contractor. 

Q. Please provide an analysis of the $250,000 cost over each year of the contract, from 
2008 to the present, and a breakdown of the costs per year associated with Raytheon’s 
performance and those associated with FAA providing training. 

A. Please see Attachment A for information concerning the cost for each training element, 
including contractor and FAA-provided training, for each year of the ATCOTS contract. Since the 
contract was awarded in September 2008, it begins with fiscal year 2009. 


Interna! analysis by FAA personnel yielded similar results. 
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Q. Please provide detailed information as to what training is being performed by 

Raytheon and by FAA, and the cost for that particular training element. 

A. The controller training process encompasses two main elements: Academy Training and Field 
Training. We maintain detailed cost data under the ATCOTS contract and we are in the process of 
differentiating and aggregating the costs of training supplied by FAA personnel. 

• Academy training consists of Initial Qualification training for new hire controllers and 
transfer controllers. This training involves academic classroom and simulation training 
focused on air traffic control regulations, fundamental skills and application of procedures 
in a synthetic environment. Academy training also consists of specialized courses such as 
“Airspace and Procedures” and “Enhanced Traffic Management Coordinator” which are 
provided to fully certified controllers, managers and supervisors based on Field facility 
requirements. 

• Field training consists of furthering new hire and transfer controller “Qualification” 
training at assigned facilities via classroom and simulation training followed by On-the-Job 
Training (OJT), as the student progresses through a series of training stages based on the 
type of facility (tower, terminal radar or en route). Field training also includes 
“Proficiency” training consisting of three types; 1) Skill Enhancement, 2) Refresher and 3) 
Supplemental and is required and provided for every controller in the National Airspace 
System. Field training reinforces the fundamentals taught at the Academy and applies real 
world conditions, procedures, and the teamwork required for air traffic control in the ATC 
facility. 

• Academy training, field classroom and field simulation training is provided by the 
ATCOTS contractor at specific FAA locations, and provided by FAA certified professional 
controllers. Field OJT is always provided by FAA certified professional controllers 
because it involves training under live operational conditions. 

The table below provides a breakdown for the five completed contract years. ATCOTS contractor 
training costs are identified by type of training at both the Academy and in the Field. 
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L_ ___ . 

Total 1 


[Academy Training 

$120,627,740 I 

Initial Qualification Cost 

$119,488,696 

Specialized Cost 

$ 1,139,044 

[Field 

$269,340,060 | 

Qualification Training Costs 

$194,401,694 

Dev/Prof Training Costs 

$ 74,938,366 

{program Management Costs 

$ 51,421,275 1 


5-Ytfar Contractor Training Costs 

$441,388,0751 


2. The FAA’s acquisition guidelines require that FAA address any cost discrepancies when 
there is a deviation of more than 15% from the government’s estimate. Raytheon’s cost 
proposal was 29% less than the FAA’s Independent Government Cost Estimate. 

Q. Why did the FAA not follow its own guidelines and take any remediation action, 
such as asking Raytheon for a revised proposal? 

A. The FAA acquisition guideline referred to in this question was not in effect at the time the 
ATCOTS contract was awarded. 

The FAA modified its acquisition guidelines in July 2012 to require an explanation to the Chief 
Financial Officer if a selected vendor’s proposal is greater than 15% below the Government’s 
Independent Cost Estimate (IGCE). Prior to that time, the acquisition guidance only required 
additional review by the Chief Financial Officer’s office if the selected vendor’s proposal is 
greater than 15% above the IGCE. The Air Traffic Control Optimum Training Solution 
(ATCOTS) contract was awarded in September 2008, four years before this policy change. 

The FAA’s decisions concerning the cost and technical evaluations were consistent with FAA 
policy at that time, the solicitation criteria and solicitation evaluation plan, and best practices. 


3. The FAA did not take sufficient steps to stem cost overruns after the Inspector General’s 
report, and costs continued to increase over the next two contract years. By year four, 
the contract had run out of money. 

Q. When, approximately, did the FAA determine that the contract would run out of 
money? 
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A. Due to unanticipated cost growth during the initia! performance years, the FAA determined at 
the end of the third performance year that the contract would reach the total contract base period 
ceiling amount during fourth year of contract performance. This determination was based on the 
program continuing to operate at the average contract bum rate, but with a few adjustments; the 
FAA provided written direction to the contractor to continue providing training delivery support in 
accordance with the Performance Work Statement and Annual Work Plan to the maximum extent 
possible within the contract ceiling. 

Q. What, if any, steps did FAA take to mitigate hitting the contract ceiling? 

A. The first step the FAA took was to issue Contract modification 0063 which established the 
revised contract year 4 ceiling value and target cost. Raytheon was expected to continue to 
provide training delivery support in accordance with the ATCOTS Performance Work Statement, 
Annual Work Plan, and the FAA’s revised requirements noted in correspondence submitted to the 
contractor in June 2012. As part of the Monthly Status Report, the contractor was expected to 
identify and describe separately any issues and^r concerns. Assessments of critical and time 
sensitive issues/concems so identified should have included sufficient detail to provide the FAA 
insight on the necessary actions to overcome the situation. This combination of steps was geared 
to assuring that Raytheon stayed within the fourth year of the contract’s ceiling and that any risks 
to staying within that amount were quickly and efficiently handled. 

The FAA also implemented other steps to reduce the contract’s costs, including the use of FAA 
instructors where available, an award fee designed to further encourage cost control, and 
implementation of a tool to aid the agency to better forecast and control our field training 
requirements. 

4. At the hearing, you testified that there was a discrepancy about the number of controllers 
that Raytheon was required to train in the first year. You provided the number of 4,600 
and Raytheon has cited the number 5,260. Both numbers are over the initial proposed 
number of 4,000 controllers to be trained. 

Q. How does FAA explain this discrepancy? 

A. The manner in which the number is calculated will lead to different results. The FAA believes 
the best method to identify training demand is to identify the number of “in process” ATC trainees 
at a particular point in time. The FAA calculates that approximately 4,600 ATC trainees were in 
process at any given time in the first year of the contract. That number will vary at different points 
throughout the year. For example, in August 2009, the FAA reported that there were 4,375 
controllers in training. That is merely a “snap shot” in time. If the FAA added all controllers that 
had completed training earlier in the year, or who would be trained later in the year to that number, 
it would naturally be higher. 

One can also use that method, however, and count the total number of individuals that received 
any type of training during the calendar (or fiscal) year. That will yield a higher estimate. While 
such a figure would not be inaccurate, the FAA believes that this method of calculation overstates 
the actual demand for services. 
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Q. Does the FAA’s number include recruits that washed out and started training over 
again? 


A. Yes. 


Q. Please provide detailed estimate of the number of persons in training by location or 
facility. 

A. The FAA has provided a chart that contains details about the number of individuals in training 
at each facility. Please see Attachment B. 

Q. What levels of controller training does the 4,600 number account for? 

A. The FAA does not use the term “levels” of controller training, but it does categorize training. 
The 4,600 number accounts for Qualification Training for new hire controllers and transfer 
controllers. This training involves academic classroom and simulation training focused on air 
traffic control regulations, fundamental skills and application of procedures in a synthetic 
environment. 

S. Raytheon submitted several proposals aimed at innovation. The FAA has stated that the 
contractor did not submit Class B proposals and submitted white papers instead. Raytheon 
has reported that FAA directed it not to submit formal proposals and to submit white 
papers. 

Q. Did the FAA tell Raytheon not to submit Class B proposals? 


A. No. 


Q. Why has the FAA not responded to these proposals at all? 

A. The FAA has not responded to the white papers submitted because they do not provide 
sufficient information to allow the Agency to make a decision. 

Last year, Raytheon submitted a combination of proposals and pre-proposal documents, also 
referred to as white papers. Several of the white papers are still under consideration. However, 
these documents do not address the minimum requirements that are needed for the FAA to 
adequately evaluate and approve or disapprove the proposed process improvement. The ATCOTS 
contract requires the proposals to describe the proposed change, assumptions, transition, schedule, 
cost, and risks. If the proposal is categorized as a Class B proposal, then the proposal must also 
address safety, property, governing documents, connectivity, and a testing plan. The proposals 
submitted by Raytheon do not contain that information. 
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‘ be^n on 8 September 2008, therefore data presented begins in Pf2009. 
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RAYTHEON PROPRIETARY /COMPETITION SENSITVE 


Post-Hearing Questions for the Record 
Submitted to Ms. Lynn Dugle 
From Senator Claire McCaskill 

“Management of Air Traffic Controller Training Contracts” 
January 14, 2014 


1 . During the hearing, the Federal Aviation Administration (FAA) cited $250,000 as the average 
cost to train an air traffic controller, and that 25% of this cost was associated with contractor work and 
75% was associated with costs to the FAA, 

Q. Please provide an analysis of Raytheon’s cost to train over each year of the contract, from 2008 to 
the present, and a breakdown of the costs per year associated with training provided by Raytheon. 

Q. Please provide detailed information as to what training is being performed by Raytheon and the 
cost for that particular training element. 
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The controllei training process encompasses two main elements: Academy Training and Field Training. 
Academy training consists of classroom and simulation training focused on regulations, fundamental 
skills and application of procedures in a syntlictic environment. Specialized courses such as “.Airspace 
and Procedures” and “Enhanced Traffic Management Coordinator" which are provided to fiilly certified 
controllers, managers and supervisors based on Field fecility requirements are also a significant 
component of Academy operations. Field training consists of classroom and laboratory training as well 
as On-the-Job Training (OJT). Field training reinforces tlie fimdanientals taugin at the Academy and 
applies real world conditions, procedures, and the teamwork required for “live" air traffic control. 
Raytheon provides the Academy training as well as classroom and laboratory training in the field. All 
On-the-Job training is provided by the FAA. 

The table below provides a detailed breakdown of the costs per year associated with training provided by 
Raytheon. As shown in the data below, the costs and number of students trained each year fluctuates as 
the stages, mix (Terminal versus En Route), and progression of smdents through the system changes. 
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RAYTHEON PROPRIETARY / COMPETITION SENSITVE 


Academy Training: 



Raytheon conducts classroom and simulator lab instruction, supports the development and maintenance of 
Academy classroom and simulation lab trahiing materials, maintains student ttaining records and provides 
training management of services provided. 

In the table above, “Academy Student Cost” includes: 

• Air Traffic Basics - En Route and Terminal courses, smdents assigned based on FAA hire 
source. 

• Tennuial Tower - for students to be assigned to field tower faeihties 

• Tenninal TRACON - Introduction to Terminal Radar and Radar Training Facility (RTF) 
courses, for students assigned to field TRACON facilities 

• En Route - for students assigned to field En Route facilities 

The “Academy Students" includes both new liires, as well as. Academy graduates that come back for 
additional qualification training once they acliieve a level of field qualification. 

In the table above, “Specialized Cost” includes: 

Specialized - includes various non- Qualification related training courses such as Quality 
Assurance Program Administration and Airspace and Procedures. 

The “Specialized Students” are certified controllers tliat require supplemental training on job specific 
topics usually to suppeat various staff support fiuictions. 

Raytheon staffing in support of each coiuse is based on a specific staffing models co-devcloped by FAA 
and Raytheon to achieve efficiency objectives while maintaining FAA directed student/instructor ratios 
for classroom and simidation lab session witliin each course. Each course has a luiique staffing model 
tailored to a specific munber of students attending. 
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RAYTHEON PROPRIETARY / COMPETITION SENSITVE 



Raytheon provides classroom and laboralor>' training for new-lrirc smdents, students transfening from 
fiicility to facility, and proficiency training for all controllers at each assigned facility. Specific tasks 
performed include the conduct of classroom and simulator lab instruction, the development and 
nraintenance of field classroom and simulation lab training materials, the maintenance of smdail Baining 
records and management of training services provided. 

Proficiency training includes several categories: Supplemental, which supports the deployment of a 
variety of NextGen initiatives including new NAS systems such as ERAM. TAMR. RNAV/RNP. ADS- 
B; Skill Enhancement which tar gets specific perfonnance improvement subjects; and Refresfier/Recurreiit 
training which focuses on seasonal and safety related topics among others. Also included are Mandatory 
Briefing Items (MBls) as directed nationally. The table above shows the combined aimual costs for 
overall ttaining development and Proficiency training. 

The “Qualification Training Smdents’’ includes qualification in-progress students, successflil student 
certifications, and the number of uusuccessftil smdents (failures) during the period. The sowce that 
Raytheon uses to identify tlie Field Qtalification total smdent cotmt is the FAA’s National Training 
Database (NTD). 

The “Development / Proficiency Smdents” includes all acraal onboard, which includes certified 
controllers and developmentals that require proficiency training as described above. 



This value represents all training costs provided by Raytheon as part of the ATCOTS contract. 
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Ffe/Other: 



The “Other” category iuchides all noii-tramiiig costs including the Fixed ftice (FFP) and Cost Pius Fixed 
Fee (CPFF) task orders and the Central Development Center (CDC). The CDC efforts were performed 
during contract years one through four by a team located at the FAA Academy. The team developed 
supplemental course material as reqirested by FAA for use at the Acadenry and at Field Sites. 


Total ATCOTS Cost: 



This value rqtresents all of Raytheon's cormnitted costs against the ATCOTS contract as noted above. 
Note that all costs associated with program management have been allocated against the training elements 
listed above. This includes performing all necessary actions to manage the program as well as provide 
deliverables to the FAA in accordance with the contract. Notable items included in these costs are Earned 
Value Management as well as a quality management program. 
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2. At the hearing, FAA testified that there was a discrepancy about the number of number of 4,600 and 
Raytheon has cited the number 5,260, Both numbers are over the initial proposed number of 4,000 
controllers to be trained. 

Q. How does Raytheon explain this discrepancy? 

The source that Raytheon uses to identify the Field Qualification student count is the FAA’s National 
Training Database (NTD), Raytheon includes qualification in-progress students, successful student 
certifications, and the number of unsuccessful students (failures) during the period which equates to the 
total discrete students in field training. 

The table below shows Raytheon’s measurement of the distribution of Field Qualification students for 
program year 2 which totals 5,621. The data is sourced from the FAA NTD on 10/18/10. 
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**TOTAL DEVELOPMENTAtS NOTE: UNSUCCE5S5FUI DEVELOPNENTALS WHO ARE STia ATTHE 

FACILITY ARE COUNTED AS "IN PROGRESS" UNTIL THEY ARE PERMANENUY REMOVED FROM THE 

FACILITY. THESE ARE SUBTRACTED OUT SO THAT THEY ARE NOT DOUBLE COUNTED IN FINAL TOTAL 


Q. Does the Raytheon’s number include recruits that washed out and started training over again? 
Yes, those students are included in Raytheon’s in-progress numbers. Under an FAA approved Employee 
Requested Relocation (ERR) students may be transferred from their originally assigned facility and 
training programs to another facility. As noted in the table above, these students are not being “double- 
counted,” although these students do represent an increased cost to the training program. 

Q. What levels of controller training do the 5,620 number account for? 

The number accounts for all qualification training for controllers in all field stages or levels of training 
(except On-the-Job Training which is provided 100% by the FAA) during that government fiscal year. 
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